Information processing apparatus, information processing method, program, and information processing system
阅读说明:本技术 信息处理设备、信息处理方法、程序和信息处理系统 (Information processing apparatus, information processing method, program, and information processing system ) 是由 海野惠助 高岛昌利 于 2018-06-04 设计创作,主要内容包括:为了能够生成适当地指示植被状态的时间序列变化的植被变化信息,本发明要处理的对象是包括与指示环境光的各成分比率的比率信息相关联的多个时间点的植被数据的数据组。本发明设置有:提取单元,其通过使用比率信息从数据组中提取要使用的植被数据;以及生成单元,其通过使用通过提取单元提取的植被数据来生成指示植被状态的时间序列变化的植被变化信息。由于使用比率信息,因此可以收集在类似环境光条件下获得的植被数据。(In order to be able to generate vegetation change information that appropriately indicates time-series changes in vegetation state, the object to be processed by the present invention is a data set including vegetation data at a plurality of points in time associated with ratio information indicating the ratio of components of ambient light. The invention is provided with: an extraction unit that extracts vegetation data to be used from the data group by using the ratio information; and a generation unit that generates vegetation change information indicating a time-series change of vegetation states by using the vegetation data extracted by the extraction unit. Because of the use of ratio information, vegetation data obtained under similar ambient light conditions can be collected.)
1. An information processing apparatus comprising:
and an extraction unit that extracts at least part of vegetation data from vegetation data at a plurality of time points associated with the ratio information, respectively, based on the ratio information that is the ratio of the components of the ambient light.
2. The information processing apparatus according to claim 1, further comprising:
and a generation unit that generates vegetation change information indicating a time-series change of the vegetation data by using the vegetation data extracted by the extraction unit.
3. The information processing apparatus according to claim 1,
the ratio information is a value of a ratio of a detection value of the direct light to a detection value of the scattered light, or a value of a ratio of a detection value of the total sunlight to a detection value of the scattered light.
4. The information processing apparatus according to claim 1,
the extraction section performs the following processing: a value excluding the associated ratio information from the vegetation data to be used is determined as vegetation data in the vicinity of a specific value by comparison with a threshold value.
5. The information processing apparatus according to claim 1,
the extraction section performs the following processing: vegetation data is extracted in which the value of the associated ratio information differs from a specific value by at least a prescribed amount.
6. The information processing apparatus according to claim 1,
the extraction section performs the following processing: extracting values of the associated ratio information is determined as a plurality of sets of vegetation data close to each other by comparison with a threshold value.
7. The information processing apparatus according to claim 1,
the extraction section performs the following processing: the value of the extraction-associated ratio information is determined as vegetation data in the vicinity of a specific value by comparison with a threshold value.
8. The information processing apparatus according to claim 1,
the extraction conditions for the extraction process by the extraction section can be variably set.
9. The information processing apparatus according to claim 2,
the generation unit converts the vegetation data extracted by the extraction unit into a value obtained by adjusting the ratio information to a fixed value, and generates vegetation change information using the converted vegetation data.
10. The information processing apparatus according to claim 1, further comprising:
and a vegetation data calculation unit that calculates vegetation data by using the vegetation observation data at each time point.
11. The information processing apparatus according to claim 10,
the vegetation data calculation unit obtains the NDVI value as vegetation data.
12. The information processing apparatus according to claim 1, further comprising:
and a ratio calculation unit that calculates ratio information as a component ratio of the ambient light by using the detected value of the ambient light at each time point in association with the vegetation data at each time point.
13. The information processing apparatus according to claim 12,
the ratio calculation section calculates ratio information by using detection values obtained at the respective light receiving sections by an ambient light sensor including a light receiving section that casts a shadow by a light-shielding body and a light receiving section that is not affected by the light-shielding body.
14. An information processing method comprising:
the following processing is performed by means of an information processing apparatus: vegetation data to be used is extracted from a data group including vegetation data of a plurality of time points respectively associated with ratio information by using the ratio information as a component ratio of ambient light.
15. A program for causing a computer apparatus to execute: vegetation data to be used is extracted from a data group including vegetation data of a plurality of time points respectively associated with ratio information by using the ratio information as a component ratio of ambient light.
16. An information processing system comprising:
an ambient light sensor, comprising: a light receiving unit for projecting a shadow by the light-shielding body and a light receiving unit not affected by the light-shielding body;
a ratio calculation unit that calculates ratio information as a component ratio of the ambient light from the detection values obtained at the respective light receiving units in association with the vegetation data at the respective time points;
an extraction section that extracts vegetation data to be used from a data group including vegetation data of a plurality of time points respectively associated with ratio information by using the ratio information as a component ratio of ambient light; and
and a generation unit that generates vegetation change information indicating a time-series change in vegetation state by using the vegetation data extracted by the extraction unit.
Technical Field
Background
For example, there has been an attempt to perform remote sensing of vegetation status of vegetation by capturing an image of vegetation status while moving a small flying body having an image capturing device mounted thereon over a farmland.
CITATION LIST
Patent document
Patent document 1: japanese patent No. 5162890
Disclosure of Invention
Technical problem
The vegetation index may be measured from a captured image of vegetation in the field. For example, vegetation change information indicating time-series changes in vegetation status may be generated when a vegetation index is obtained from images captured daily. For example, as the vegetation index, NDVI (normalized vegetation index) is obtained and arranged in time series, so that a change in vegetation status can be confirmed.
However, for vegetation indices (such as NDVI), the value fluctuates due to differences in conditions such as weather (sunny/cloudy). Therefore, even when it is desired to confirm daily changes in NDVI, for example, vegetation change information in which NDVI is arranged in time series includes value fluctuations caused by weather. Therefore, even if the vegetation change information is viewed, the worker or the like cannot correctly recognize the daily change of vegetation.
Therefore, an object of the present technology is to make it possible to generate vegetation change information that is less likely to be affected by conditions such as weather, and to appropriately present time-series changes in vegetation status.
Solution to the problem
An information processing apparatus according to the present technology includes:
and an extraction unit that extracts at least part of vegetation data from vegetation data at a plurality of time points associated with the ratio information, respectively, based on the ratio information that is the ratio of the components of the ambient light.
That is, a data group including vegetation data at a time point associated with a component ratio (ratio information) of the ambient light at the corresponding observation time is an object to be processed. In this case, vegetation data suitable for output is extracted based on the ratio information.
Further, the information processing apparatus includes a generation section that generates vegetation change information indicating a time-series change of vegetation data by using the vegetation data extracted by the extraction section.
That is, vegetation variation information is generated by using vegetation data suitable for output and having been extracted by the extraction section based on the ratio information.
In the information processing apparatus, the ratio information may be a value of a ratio of a detected value of the direct light to a detected value of the scattered light, or a value of a ratio of a detected value of the total sunlight to a detected value of the scattered light.
For example, direct light is a light component directly from a light source such as the sun (so-called direct sunlight), and scattered light is light scattered by molecules and cloud particles in the atmosphere. The sum of the direct and scattered light is the total sunlight.
In the information processing apparatus, the extraction section may perform the following processing: vegetation data in which a value of the associated ratio information is determined as a value in the vicinity of a specific value by comparison with a threshold value is excluded from the vegetation data to be used.
For example, in the case where the ratio information is (direct light)/(scattered light), the ratio information is in the vicinity of 0 in cloudy weather.
For example, in the case where the ratio information is (total sunlight)/(scattered light), the ratio information is in the vicinity of 1 in cloudy weather. The value "0" or "1" is set to a specific value, and vegetation data whose value of the ratio information is equal to or greater than the specific value is excluded.
In the information processing apparatus, the extraction section may perform the following processing: vegetation data is extracted in which the value of the associated ratio information differs from a specific value by at least a prescribed amount.
For example, in a case where the ratio information is calculated such that the ratio information becomes "0" or "1" in cloudy weather, the value "0" or "1" is set to a specific value, and vegetation data whose ratio information is sufficiently separated from the specific value is extracted as vegetation data to be used (or a candidate thereof).
In the information processing apparatus, the extraction section may perform the following processing: extracting respective values of the associated ratio information is determined as a plurality of sets of vegetation data close to each other by comparison with a threshold value.
The case where the ratio information as the component ratio of the ambient light is close to each other means that the states of the ambient light at the observation time for calculating the vegetation data are similar to each other.
In the information processing apparatus, the extraction section may perform the following processing: the value of the extraction-associated ratio information is determined as vegetation data in the vicinity of the specific value by comparison with a threshold value.
For example, in a case where the ratio information is calculated such that the ratio information is "0" or "1" in cloudy weather, the value "0" or "1" is set to a specific value, and vegetation data whose ratio information is in the vicinity of the specific value is extracted as vegetation data (or a candidate thereof) to be used.
In the information processing apparatus, the extraction conditions for the extraction process by the extraction section may be variably set.
For example, the conditions may be variably set for extraction processing such as vegetation data in which the exclusion ratio information is close to a specific value, vegetation data in which the extraction ratio information is sufficiently separated from a specific value, a plurality of sets of vegetation data in which the extraction ratio information is close to each other, and vegetation data in which the extraction ratio information is close to a specific value.
In the information processing apparatus, the generation section may convert the vegetation data extracted by the extraction section into a value at which the ratio information is adjusted to be fixed, and may generate the vegetation change information by using the converted vegetation data.
For example, vegetation variation information is generated by using vegetation data in which the extracted ratio information is close to each other. The vegetation data is converted to realize a state in which the value of the ratio information is fixed.
The information processing apparatus may include a vegetation data calculation section that calculates vegetation data by using vegetation observation data for each time point.
That is, vegetation data for each time point is generated in the information processing apparatus.
In the information processing apparatus, the vegetation data calculation section may find the NDVI value as the vegetation data.
That is, an NDVI value as a vegetation index is obtained, and vegetation variation information as a variation of the NDVI is generated.
The information processing apparatus may include a ratio calculation section that calculates ratio information as a component ratio of the ambient light by using a detection value of the ambient light at each time point in correspondence with vegetation data at each time point.
That is, ratio information corresponding to vegetation data at each time point is generated in the information processing apparatus. Ratio information is calculated by using light detection values obtained at substantially the same time point as the detection values used to generate vegetation data.
In the information processing apparatus, the ratio calculation section may calculate the ratio information by using detection values obtained at the respective light receiving sections by an ambient light sensor including the light receiving section at which the shadow is cast by the light-shielding body and the light receiving section that is not affected by the light-shielding body.
By using the ambient light sensor mounted on the flying object, the direct light and the scattered light can be detected by the light-shielding body.
An information processing method according to the present technology includes
The following processing is performed by means of an information processing apparatus: vegetation data to be used is extracted from a data group including vegetation data of a plurality of time points respectively associated with ratio information by using the ratio information as a component ratio of ambient light. Accordingly, vegetation data for generating vegetation change information that is less likely to be affected by environmental conditions can be extracted in the information processing apparatus.
A program according to the present technology is for causing a computer apparatus to execute: vegetation data to be used is extracted from a data group including vegetation data of a plurality of time points respectively associated with ratio information by using the ratio information as a component ratio of ambient light. Accordingly, a computer apparatus that extracts vegetation data for generating vegetation change information that is less likely to be affected by environmental conditions can be easily implemented.
An information processing system according to the present technology includes an ambient light sensor including a light receiving portion that casts a shadow by a light-shielding body and a light receiving portion that is not affected by the light-shielding body, a ratio calculation portion, an extraction portion, and a generation portion. Accordingly, a system suitable for generating vegetation change information that is less likely to be affected by environmental conditions can be constructed.
Advantageous effects of the invention
The present technique provides the following effects: vegetation change information in which fluctuations due to conditions such as weather are less likely to occur and time-series changes in vegetation status can be appropriately presented can be generated.
Note that the effect described here is not limited, and any effect disclosed in this specification can be provided.
Drawings
Fig. 1 is an explanatory diagram of a state in which an image of an agricultural field is captured according to an embodiment of the present technology.
Fig. 2 is a block diagram of an image capture device and an ambient light sensor according to an embodiment.
Fig. 3 is a block diagram of an information processing apparatus according to an embodiment.
FIG. 4 is a block diagram of a computer device that may be used in embodiments.
Fig. 5 is a transition diagram of photosynthesis photon flux density and NDVI obtained by observation in a clear region and a shadow region.
Fig. 6 is an explanatory diagram of an example of ratio information and NDVI obtained by measurement.
Fig. 7 is an explanatory diagram of the extraction process according to the embodiment.
Fig. 8 is an explanatory diagram of vegetation change information generated without being subjected to extraction processing.
Fig. 9 is an explanatory diagram of vegetation change information generated by the extraction processing according to the embodiment.
Fig. 10 is an explanatory diagram of the conversion of NDVI values according to the embodiment.
Fig. 11 is an explanatory diagram of vegetation change information generated by the extraction processing and the conversion processing according to the embodiment.
Fig. 12 is an illustration of an example of a co-linear approximation during conversion of NDVI values according to an embodiment.
Fig. 13 is a flowchart of an example of processing according to an embodiment.
Fig. 14 is a flowchart of an example of an extraction process and a generation process according to an embodiment.
Fig. 15 is a flowchart of an example of an extraction process and a generation process according to an embodiment.
Fig. 16 is an explanatory diagram of a structural example of the ambient light sensor according to the embodiment.
Fig. 17 is an explanatory diagram of an incident angle to the ambient light sensor according to the embodiment.
Fig. 18 is an explanatory diagram of a scheme for acquiring scattered light according to the embodiment.
Fig. 19 is an explanatory diagram of a scheme for acquiring total sunlight and scattered light according to an embodiment.
Detailed Description
Hereinafter, the embodiments will be explained according to the following order.
<1. arrangement of System and apparatus >
<2. extraction processing Using the ratio information >
<3. conversion processing of vegetation index using ratio information >
<4. processing example >
<5. various examples regarding light detection using an ambient light sensor >
<6. conclusion and modifications >
<1. arrangement of System and apparatus >
As an example, the embodiment will be described in a case where vegetation states of farmlands are sensed.
As shown in fig. 1, remote sensing with respect to vegetation in the
Fig. 1 shows the state of the
Compact flying
In the flying object 300, the
Various types of image capturing devices may be used as the
For example, an image file (an image captured at a specific point in time) obtained by image capturing performed by the
Further, a camera that captures images of R (red), G (green), and B (blue) visible light may be used as the
In addition, a camera for obtaining captured images of a RED wavelength Region (RED) and a near infrared region (NIR: near infrared) so that NDVI can be calculated from the obtained images may be used as the
Hereinafter, explanation will be given based on the following assumptions: a camera capable of obtaining captured images of a RED wavelength Region (RED) and a Near Infrared Region (NIR) is used as the
In addition, the tag information is added to an image obtained by image capturing performed by the
In the present embodiment, not only the
Note that to collectively refer to the use of one or more ambient light sensors, the expression "ambient
The
Note that PPFD refers to photosynthetic photon flux density only in the wavelength region of 400 to 700nm where chlorophyll can be absorbed.
The amount of total sunlight and the amount of scattered light can be detected from the detection values obtained by the
Outdoor ambient light is generally expressed by (total sunlight) — (direct light) + (scattered light).
Direct light refers to so-called direct sunlight from the
Scattered light refers to light scattered by molecules and cloud particles in the atmosphere, in addition to direct sunlight.
Total sunlight is the total light from the whole sky, which is also the sum of direct and scattered light.
Nothing for shading sunlight is provided to the ambient
A rod-shaped light-shielding
As for the direct light, the illuminance thereof may be obtained by subtracting the detection value obtained by the ambient
Sensors that respectively detect illuminance of R (red) light, G (green) light, B (blue) light, NIR (near infrared light) as ambient light may be used as the
That is, a detected value of R, G, B, IR for total sunlight (E-RED, E-GREEN, E-BLUE, E-NIR) may be obtained by ambient
Note that tag information is added to the detection values obtained by the
The reason why the rod-shaped light-shielding
The image data and the detection values obtained by the ambient
The
Note that the
Fig. 2 shows a configuration example of the
The
The
That is, in the
The lens system refers to an incident optical system including various lenses such as an incident end lens, a zoom lens, a focus lens, and a condenser lens.
The filter is a filter for extracting a wavelength to be measured of an object to be measured. This refers to a color filter that is generally formed on the image sensor, a wavelength filter that is generally disposed in front of the image sensor, and the like.
The exposure portion refers to a portion of the image sensor in which exposure control is performed by adjusting the opening amount of an optical system such as a lens system, an aperture (diaphragm), or the like, so that sensing is performed in a state where signal charges fall within a dynamic range without saturation.
The image sensor is formed to have a sensing element in which a plurality of pixels are two-dimensionally arranged in a repeating pattern on a sensor surface thereof.
The image sensor detects light that has passed through the filter by means of the sensing element, and outputs a captured image signal corresponding to the light amount of the light to the
The
When it is assumed that captured images of a RED wavelength Region (RED) and a Near Infrared Region (NIR) are obtained as image data of the object to be measured, the
The
The
For example, the
In addition, the
Therefore, with respect to the RED image data and the NIR image data stored in the
In the example of fig. 2, the detection values obtained by the
The
Further, the
Note that in the case where the
For example, a flash memory or a portable memory card, which is an internal memory of the
The
In any case, the RED image data, the NIR image data, the first ambient light data, and the second ambient light data stored in the
Note that in the case where a portable memory card or the like is used as the
Next, the configuration of the
Fig. 3 shows a functional configuration of the
The
The storage unit 12 stores RED image data, NIR image data, first ambient light data, and second ambient light data acquired by the
The
The vegetation
Specifically, the vegetation
By using the stored RED and NIR image data, the NDVI can be calculated by the following equation
NDVI=(1-RED/NIR)/(1+RED/NIR)。
Note that total daylight data is acquired as the first ambient light data, and scattered light is acquired as the second ambient light data. NDVI may be corrected using the RED light detection value E-RED and the near infrared light detection value E-NIR of the total sunlight acquired at the same (or substantially the same) time as the acquisition time of the RED image data and the NIR image data.
That is, the reference coefficient is defined as α, and the correction coefficient k is obtained α · E-NIR/E-RED with the correction coefficient α, NDVI is set to a value corrected by NDVI ═ 1-k · RED/NIR)/(1+ k · RED/NIR).
The vegetation
The
The component ratio of the ambient light is a ratio of (decomposable) components included in the ambient light (for example, an illuminance ratio of the components).
In this case, the composition ratio of the ambient light is a ratio of total sunlight to scattered light, or a ratio of direct light to scattered light. That is to say that the position of the first electrode,
ratio information (direct light)/(scattered light)
Or
Ratio information is (total sunlight)/(scattered light).
In addition, the detection values include detection values E-RED, E-GREEN, E-BLUE, E-NIR of R, G, B, IR, and for example, the G detection value E-GREEN is used to calculate ratio information. For example,
the ratio information is (G detection value of direct light (or total sunlight) E-GREEN)/(G detection value of scattered light E-GREEN).
Alternatively, the illuminance may be obtained by using the value of the detection value (E-RED) + (E-GREEN) + (E-BLUE), and then the ratio information may be obtained by:
ratio information is (illuminance of direct light (or total sunlight)/(illuminance of scattered light).
The ratio information calculated by any of the above methods is stored in the storage section 12 in association with the NDVI of the corresponding date and time/position.
The
That is, the NDVI at each time point is obtained and held by the vegetation
Note that it is not particularly necessary to extract a part of NDVI at each time point. When permuted, all NDVI can be used as vegetation change information indicating time series changes in NDVI. However, in this case, even NDVI values unsuitable for time series observation are included due to the influence of weather. The present embodiment attempts to extract NDVI suitable for time series observation, and create vegetation change information by using the NDVI.
The
The
The
For example, the
Alternatively, for example, the
Alternatively, for example, the
Although a specific processing example will be described later, the calculation section 10 (or the
In addition, the
Further, in the above configuration, the vegetation
Further, the functions of the
Next, a hardware configuration example (computer device 150) of the
As shown in fig. 4, the computer apparatus 150 includes a CPU (central processing unit) 51, a ROM (read only memory) 52, and a RAM (random access memory) 53.
The CPU51 executes various processes in accordance with a program stored in the ROM 52 or a program loaded from the recording section 59 into the RAM 53. The RAM 53 also records data and the like necessary for the CPU51 to execute various processes as appropriate.
The CPU51, ROM 52, and RAM 53 are connected to each other via a bus 54. An input/output interface 55 is also connected to the bus 54.
A display 56 including a liquid crystal panel, an organic EL (electroluminescence) panel, and the like, an input section 56 including a keyboard, a mouse, and the like, a speaker 58, a recording section 59 including an HDD (hard disk drive), and the like, a communication section 60, and the like can be connected to the input/output interface 55.
Display 56 may be integrated with computer device 150 or may be a separate device. For example, a captured image or a synthesized image is displayed, or an evaluation index is displayed.
The input unit 57 is an input means used by the user using the computer device 150.
The communication section 60 performs a communication process through a network including the internet, or performs communication with a peripheral device.
The driver 61 may also be connected to the input/output interface 55 if necessary. To which the memory card 62 can be connected. If necessary, a computer program read out from the memory card 62 may be installed into the recording section 59, or data processed at the CPU51 may be recorded in the recording section 59. Obviously, a recording and reproducing drive for a removable recording medium such as a magnetic disk, an optical disk, or a magneto-optical disk may be used as the drive 61.
With this hardware configuration, the processing to be performed by the
Note that the
In addition, the computer device 150 in fig. 4 may be implemented as a desktop or laptop personal computer, or a portable terminal such as a tablet terminal or a smart phone. In addition, the function of the
<2. extraction processing Using the ratio information >
Vegetation index data (NDVI) extraction processing using ratio information to be performed by the calculation section 10 (
First, the necessity of the extraction process will be explained with reference to fig. 5.
Fig. 5 shows NDVI and PPFD observed during a certain period of time (here, a period of time from 11
In particular with respect to PPFD, two samples taken at the same time of day are indicated. White circles respectively indicate values observed by the light sensors disposed in a clear region, and black circles respectively indicate values observed by the light sensors disposed in a shadow region.
Here, a light sensor disposed in a clear area is discussed. Since the light sensor provided in a clear area is exposed to direct sunlight, a detection value of total sunlight including a direct light component can be obtained by the light sensor. However, this occurs in clear weather. In cloudy weather (including overcast and rainy weather), the direct sunlight component is substantially excluded. That is, the detected value of the total sunlight obtained is almost all the scattered light component.
On the other hand, the light sensor disposed in the shadow area so as to obtain the value indicated by the black circle is disposed at a position shielded even in sunny weather. Regardless of the weather, the scattered light component can be detected by the sensor.
Herein, NDVI values are not necessarily considered to be directly related to PPFD (or illumination). However, the NDVI measured externally may be affected by ambient light. This is a factor fluctuating according to changes in weather or the like.
Meanwhile, the ratio of the detection value obtained by the clear area sensor to the detection value obtained by the shadow area sensor is a value depending on the weather to some extent.
Therefore, in the present embodiment, ratio information is generated in the above-described manner, and NDVI values suitable for time-series observation are extracted based on the ratio information. In other words, a concept of excluding samples that vary according to weather conditions is employed.
Specific examples will be described below.
Note that ratio information is described as an example of (direct light)/(scattered light).
Fig. 6A shows ratio information values and NDVI values observed during a certain period of time. The ratio information of 0 (or in the vicinity of 0) indicates that direct light of 0, i.e., cloudy days (including rainy days).
Note that, in the case where the ratio information is (total sunlight)/(scattered light), the total sunlight is scattered light. Therefore, in cloudy weather, the ratio information is around 1.
In fig. 6B, the values in fig. 6A are shown such that the horizontal axis represents ratio information and the vertical axis represents NDVI values.
An extraction process is performed on such daily NDVI data.
Specific examples of the extraction process include:
(process 1) excluding NDVI data with an ambient light component ratio around 0;
(process 2) extracting NDVI data of which ambient light component ratio is sufficiently larger than 0 as a candidate; and
(process 3) sets of NDVI data in which the ratios of the ambient light components (ratio information) are close to each other are extracted from the NDVI data extracted as candidates.
In this example, in the
In the
In process 3, sets of NDVI whose ratio information are close to each other are extracted. In this case, NDVI data of 11 months, 6 days, 7 days, and 13 days were finally extracted. Fig. 7A and 7B depict the NDVI data for 11 months, 6 days, 7 days, and 13 days of final extraction, respectively.
As a result of this extraction process, vegetation change information suitable for time series observation can be generated.
For comparison, fig. 8 shows a case where the extraction process is not performed. Fig. 8A shows NDVI data groups associated with ratio information obtained from day 5 of 11 months to day 27 of 11 months.
Fig. 8B shows vegetation change information generated by using all NDVI data without undergoing extraction of usage rate information. As shown in fig. 8B, the change in the NDVI value is large, and it is difficult to observe the change state of the NDVI during this period.
On the other hand, fig. 9 shows a case where the extraction processing is performed. Fig. 9A shows the same NDVI data set as fig. 8A. The ratio information and NDVI extracted by the above-described
Fig. 9B illustrates vegetation change information generated by using the extracted NDVI data. In the vegetation change information in fig. 9B, changes caused by the influence of weather conditions are excluded, and vegetation changes during the period are easily observed.
Note that in the case where the ratio information is (total sunlight)/(scattered light), data of NDVI in which the ambient light component ratio is in the vicinity of 1 is excluded in the above-described
<3. conversion processing of vegetation index using ratio information >
Another example of a method for generating vegetation change information obtained by reducing the influence of changes due to weather conditions will be explained. The extraction processing is performed on the daily observation data by:
(process a) NDVI data in which the ambient light component ratio is around 0 is excluded;
(process b) extracting NDVI data having a value of the ambient light component ratio sufficiently larger than 0 as a candidate; and
(process c) an approximate expression is obtained from the correlation between the NDVI data extracted as a candidate and the ratio information, and conversion is performed by adjusting the value of the ambient light component ratio to be fixed.
Treatments a and b are similar to
Through the processes a and b, for example, NDVI other than NDVI with the ratio information of 0 is extracted from the data group in fig. 6A. Fig. 10B shows the extracted NDVI value (NDVI value before conversion).
A correlation is confirmed between the NDVI value and the ratio information value before conversion, and thus a collinear approximation can be performed. The inclination of the approximate straight line L1 is assumed to be-0.0173.
In this case, the ratio information distributed in the range of 3.00 to 5.00 is converted into a fixed value. For example, conversion is performed so that the ratio information becomes 4.0.
Note that 4.0 is an example. The fixed value may be arbitrarily defined. For example, an average value, a median value, a centroid value, etc. of the extracted ratio information of the NDVI may be used.
The NDVI value converted by adjusting the ratio information to a fixed value of 4.0 is defined by the following equation:
the converted NDVI value is 0.0173 × (ratio information value-4.0) + NDVI.
Therefore, conversion may be performed so as to obtain a state in which the ambient light component ratio is a fixed value of 4.0.
Fig. 10A shows NDVI (converted value) obtained by conversion of the ratio information of 4.0 in fig. 10B, such converted value is denoted by "*".
Vegetation change information is generated by using the converted NDVI values.
Fig. 11A shows a data set of NDVI associated with ratio information obtained from day 5 to day 27 of 11 months. The value of NDV is a converted value obtained by converting so that the ratio information is 4.0.
Fig. 11B shows vegetation change information using the converted values. In this case, vegetation changes can be well identified from the information. For example, it can be seen that NDVI improved for some reason (e.g., fertilization) around 11 months and 14 days.
Incidentally, in the case of fig. 11, the conversion of the first half of the time period (11 months, 5 days to 13 days) is performed by the collinear approximation in fig. 10B, and the conversion of the second half of the time period (11 months, 14 days to 27 days) is performed by a different collinear approximation. For example, in this case, the value of NDVI in the second half of the period is greater than the value of NDVI in the first half of the period. The approximate straight line of the value of NDVI in the latter half of the period is the approximate straight line L2 shown in fig. 12. When the inclination of the approximate straight line L2 is equal to the inclination of the approximate straight line L1, the converted NDVI value obtained by the above expression can be obtained.
Note that in the case where groups of NDVI values (a group in the first half of the period and a group in the second half of the period) are generated as described above, it is not necessary to approximate the groups by respective straight lines having the same inclination. The observed NDVI values may result in an approximately straight line with different slopes.
Further, in the example in fig. 12, the approximate curve of the latter half of the period is in a state shifted in the direction of the arrow D1 (upper right direction). This indicates an upward trend in the NDVI value. In contrast, in the case where the approximate straight line is shifted in the direction of the arrow D2 (lower left direction), a downward trend of the NDVI value is indicated.
<4. processing example >
An example of the processing performed by the calculation section of the
Fig. 13A, 13B, and 13C respectively show the processing executed by the
First, NDVI calculation processing in fig. 3 will be explained.
In step S100, the
In step S101, the
Note that R, G, B, IR detection values (E-RED, E-GREEN, E-BLUE, E-NIR) for total sunlight and R, G, B, IR detection values (E-RED, E-GREEN, E-BLUE, E-NIR) for scattered light are employed as ambient light data. In the NDVI calculation process, the detection values E-RED, E-NIR of total sunlight are used.
In step S102, the
NDVI=(1-k·RED/NIR)/(1+k·RED/NIR)。
the
Next, the calculation process of the ambient light component ratio (ratio information) in fig. 13B will be explained.
In step S200, the
Note that this processing can be actually executed by the same routine as step S101 in fig. 13A. R, G, B detection values (E-RED, E-GREEN, E-BLUE) of total daylight are obtained and saved to calculate ratio information.
In step S201, the
In step S202, the
Ratio information is obtained as (LA-LB)/LB, where the illuminance of total sunlight obtained by using R, G, B detection values (E-RED, E-GREEN, E-BLUE) of the total sunlight is LA, and the illuminance of scattered light obtained by using R, G, B detection values (E-RED, E-GREEN, E-BLUE) of the scattered light is LB. That is, the ratio information is direct light/scattered light.
Alternatively, the ratio information LA/LB may be obtained. That is, total sunlight/scattered light is obtained.
In addition, the ratio information may be obtained from only G detection values. That is, it is possible to obtain
Ratio information ((E-GREEN for total sunlight) - (E-GREEN for scattered light))/(E-GREEN for scattered light)
Or
Ratio information (E-GREEN for total sunlight)/(E-GREEN for scattered light).
The extraction and generation processing in fig. 13C will be explained.
In step S300, the
That is, a data group in which NDVI of each time point is associated with ratio information as shown in fig. 8A is formed.
Then, the
In step S303, a process is performed to control the storage unit 12 to store the generated vegetation change information (for example, information in fig. 9B or fig. 11B) or to control the
Various examples of steps S301, S302 are shown in fig. 14 and 15.
Fig. 14A is an example in which extraction is performed by the above-described (process 1), (process 2), and (process 3).
In step S350, the
For example, the threshold th1 is set to 0.5, and NDVI data of the ratio information < th1 is excluded. Note that the threshold th1 of 0.5 is only one example. Besides, the threshold th1 may be set to 0.1 or the like.
In step S351, the
In step S352, the
For example, when using one of the NDVI data candidates as a reference, the retrieval ratio information has NDVI data of a difference within 0.01 of the threshold th2, and a temporary group including the reference NDVI data is generated. This process is performed while sequentially using the NDVI data candidates as references, thereby generating a temporary group obtained by using the respective NDVI data as references. In the temporary groups, all or some of the temporary groups respectively including two or more (or a prescribed number or more) data groups are respectively set as a plurality of sets of NDVI data whose ratio information is close to each other. Alternatively, a temporary group having the largest number of groups of data or n temporary groups arranged in descending order of the number of data may each be set as a plurality of sets of NDVI data whose ratio information is close to each other.
Subsequently, the NDVI data included in these groups are finally extracted. Thus, for example, extraction such as that explained with fig. 7B and 9A is performed.
Note that, in the case where any temporary group including a plurality of sets of NDVI data is not generated, for example, the threshold th2 may be changed to 0.02 so that generation of the temporary group is performed again. Subsequently, in step S353, the
Note that in the case where the ratio information is (total sunlight)/(scattered light), data in which the ambient light component ratio is around 1 is excluded in the above-described
In addition, in the
Fig. 14B is an example in which extraction and conversion are performed by the above-described (processing a), (processing B), and (processing c).
Steps S350, S351 are similar to those in fig. 14A. That is, in step S350, the
In step S360, the
Thus, a converted NDVI value such as in fig. 11A is obtained.
Then, in step S353, the
Fig. 15A and 15B show other examples of the extraction process.
In fig. 15A, the
Obviously, only NDVI data having ratio information of 0 can be extracted.
Note that, in the case where the ratio information is total sunlight/scattered light, NDVI data having ratio information in the vicinity of 1 is extracted.
In step S371, the
That is, in this example, only NDVI observed in cloudy weather is extracted, and vegetation change information from which subsequent observations of NDVI can be made is generated.
The reason for this is that for certain vegetation types, regions, climatic conditions, soil conditions, seasons or other environmental conditions, vegetation change information suitable for time series observation can be generated only from observation data obtained in cloudy weather.
Fig. 15B is an example in which the condition of the extraction process can be variably set.
In step S380, the
After the extraction conditions are set, the
Subsequently, in step S383, vegetation change information is generated by using the extracted NDVI data.
Note that, instead of an example in which the user specifies the conditions of the extraction processing, an example may be employed in which the
<5. various examples regarding light detection using an ambient light sensor >
Next, an example will be explained with respect to the ambient
Fig. 16 shows various structural examples of the ambient
Each of fig. 16B and 16C is an example in which, in the case where the ambient
The sensor cartridge SB here refers to a housing main unit including the ambient
Fig. 16B is an example in which the rod-shaped light-shielding
Fig. 16C is an example in which an arc-shaped light-shielding
Fig. 16D and 16E are examples in which the ambient
Fig. 16D shows an example in which the roof-shaped light-shielding
Fig. 16E shows an example in which a rod-shaped light-shielding
Regarding the scattered light, it is desirable to shield only direct light of sunlight to absorb the remaining light. In view of this, the structure in fig. 16B or 16E is superior to the structure in fig. 16C or 16D. However, the structure in fig. 16C or 16D is superior to the structure in fig. 16B or 16E16 in view of reliably shielding direct light.
As shown in fig. 16A, a flying
The correction value of the direct light varies according to the difference in the incident angle of the sunlight incident on the sensor case SB of the ambient
Fig. 17A is a plan view of the sensor cassette SB provided with the ambient
Further, an IMU (inertial measurement unit) is mounted on the sensor case SB.
Two vectors (vector VB1, vector VB2) forming the upper surface of the sensor cassette SB are extracted based on the roll, pitch, and yaw values acquired from the IMU (inertial measurement unit) mounted on the sensor cassette SB. An outer product of the two vectors is obtained, thereby obtaining a vector VH (normal vector of the upper surface of the sensor case SB shown in fig. 17B) orthogonal to the two vectors. Further, based on the azimuth and attitude, daylight is extracted as a vector VS (see fig. 17B).
Here, the incident light θ of the sunlight incident on the sensor case SB can be calculated by an expression of an outer product expressed by (expression 1) below, based on the normal vector VH and the sunlight vector VS of the upper surface of the sensor case SB.
[ mathematical formula 1]
The illuminance value (LA) of the total sunlight and the illuminance value (LB) of the scattered light can be obtained from the ambient
However, since the upper surface of the sensor case SB is inclined by the angle of elevation
And therefore corrected in view of the tilt. Elevation angleObtained by the following (expression 2).[ mathematical formula 2]
By using the thus obtained incident angle θ of the sunlight to the sensor cartridge SB (i.e., to the light receiving portion 261) and the elevation angle of the sensor cartridge (i.e., the light receiving portion 261)
The illuminance obtained when a certain surface at a distance from the light source is illuminated becomes maximum when the surface is set perpendicular to the traveling direction of the light, and decreases when the surface is inclined. That is, the illuminance has a tendency to vary in proportion to the cosine of the incident angle θ (COS (θ)). That is, the illuminance has a diagonal incidence characteristic (cosine characteristic).
Therefore, a detection error in the direct light (total sunlight) is generated in accordance with the flying posture of the flying
Next, fig. 18 shows an example of a flight plan for the
The
In order to reliably obtain the illuminance of the scattered light, the ambient
Therefore, the light-shielding
In the example of fig. 18, when the flying
Therefore, the flying
The control section provided to the
As a result, the scattered light can be appropriately detected by using the ambient
Note that an example in which 360 ° rotation is not performed may be employed.
For example, the light-shielding
Next, attitude information in the case where the ambient
Fig. 19A shows the sensor cassette SB mounted on the flying
Fig. 19C shows the arrangement of the sensor cartridges SB and SBg and the
As shown in fig. 19C, the ambient
The ambient
In the sensor cartridge SB mounted on the flying
The
In addition, in order to further increase the frequency of acquiring the scattered light, detection values of the total sunlight and the scattered light are periodically acquired by the sensor box SBg provided on the ground, and the
<6. conclusion and modifications >
The embodiments have been described above. According to the embodiment, the following effects can be obtained.
The
Further, the
That is, a data group in which vegetation data at each time point is associated with ratio information on an observation time of the data is set as an object to be processed, and vegetation data (NDVI data) suitable for output is extracted based on the ratio information. Vegetation change information is generated by using the extracted vegetation data.
In some cases, variations in values of vegetation data such as NDVI may become large due to the influence of ambient light. However, only data suitable for the purpose of indicating time-series transition by using the ratio information is extracted, so that vegetation change information can be generated. That is, in the case where the conversion of values becomes large due to the influence of weather or the like, vegetation data whose values fluctuate due to the influence of weather is excluded, and vegetation change information that appropriately represents time-series changes of vegetation can be generated. This is very useful for vegetation observation.
In particular, NDVI has a tendency to include large errors and large fluctuations due to weather. However, since the fluctuating data is excluded, vegetation change information whose values can be easily compared every day can be generated, as shown in fig. 9B or fig. 11B.
In the embodiment, the ratio information is a value of a ratio of the detected values of the direct light and the scattered light, or a value of a ratio of the detected values of the total sunlight and the scattered light.
By disposing the light sensor at a clear position so as to be able to receive direct light, for example, direct light and scattered light in clear weather, the amount of total sunlight can be detected.
Further, by disposing the light sensor at a shadow position so as to be able to receive scattered light in clear weather, for example, the amount of light of the scattered light can be detected. The light quantity of the direct light is obtained by subtracting the light quantity of the scattered light from the light quantity of the total sunlight.
Here, in cloudy or rainy weather, the amount of direct light is almost zero, and the scattered light ≈ total sunlight. Therefore, in cloudy weather or rainy weather, the value of the ratio of the detection value of the direct light to the detection value of the scattered light is almost "0". Further, in cloudy weather or rainy weather, the value of the ratio of total sunlight to scattered light is almost "1". That is, the value of the ratio information depends on the weather.
By using the value of the ratio, clear weather and cloudy weather (including rainy weather) data can be appropriately distinguished from each other as vegetation data.
A transformation between a value of vegetation information obtained from an image obtained on a sunny day and a value of vegetation information obtained from an image obtained on a cloudy day may become large. Accordingly, extraction according to weather is performed on vegetation data at each time point by using the ratio information, so that vegetation data obtained under similar weather conditions can be collected.
In the embodiment, an example has been described in which the
Accordingly, extraction of vegetation data may be performed such that vegetation data obtained by observation under a specific weather is excluded from vegetation data used to generate vegetation change information. For example, the extraction of vegetation data may be performed so as to exclude vegetation data obtained by observation when there is no direct sunlight in cloudy weather (including rainy weather). Accordingly, vegetation change information with reduced weather effects can be generated.
In the embodiment, an example has been described in which the
For example, in a case where the ratio information is calculated such that the ratio information is "0" or "1" in cloudy weather, the value "0" or "1" is set to a specific value, and vegetation data whose value of the ratio information is sufficiently separated from the specific value is extracted as vegetation data (or a candidate thereof) to be used.
Based on the condition that the ratio information differs from the specific value by at least a prescribed amount, vegetation data apparently observed in a non-cloudy state can be extracted, for example. Thus, vegetation data obtained under similar ambient light conditions can be collected. This is also suitable for generating vegetation change information that reduces the effects of weather.
In the embodiment, an example has been described in which the
The case where the ratio information as the ratio of the ambient light is close to each other means that the states of the ambient light at the observation time for calculating the vegetation data are similar to each other.
Thus, multiple sets of vegetation data with ratio information close to each other can be considered samples obtained at different points in time but obtained under similar ambient light conditions. Thus, vegetation data obtained under similar environmental conditions may be collected. This is suitable for generating vegetation change information with reduced influence of weather.
In the embodiment, an example has been described in which the
For example, in a case where the ratio information is calculated such that the ratio information is "0" or "1" in cloudy weather, the value "0" or "1" is set as a specific value, and vegetation data whose value of the information ratio is in the vicinity of the specific value is extracted as vegetation data (or a candidate thereof) to be used.
Vegetation data obtained by observation under a specific ambient light state (e.g., cloudy weather) can be extracted according to a condition that the ratio information is close to a specific value. Thus, vegetation data obtained under similar ambient light conditions can be collected. This is also suitable for generating vegetation change information with reduced influence of weather.
In the embodiment, an example (fig. 15B) has been described in which the extraction conditions of the extraction process of the
Accordingly, vegetation data to be used can be extracted by selecting various conditions. For example, when the extraction condition may be variably set by the user's operation, the user may extract an arbitrary weather state to generate vegetation change information.
In the embodiment, an example has been described in which the
Accordingly, vegetation change information that is less likely to fluctuate due to the influence of ambient light can be generated. With respect to the conversion, the use of approximate expressions results in an accurate conversion.
In the embodiment, it has been described that the information processing apparatus 1 (calculation section 10) includes an example of the vegetation
As a result of the vegetation
In addition, in this example, the vegetation
NDVI is an index indicating the distribution status or activity of vegetation. The generation of vegetation change information, which is information indicating time-series changes in NDVI, is useful in observing changes in vegetation status.
In the embodiment, an example has been described in which the information processing apparatus 1 (calculation section 10) includes a
The
In the embodiment, an example has been described in which the
With the configuration having the
The present technology is not limited to the examples described in the embodiments, and various modifications may be made thereto.
NDVI has been described as an example of vegetation data. However, various types of vegetation indices may be employed as vegetation data. Examples thereof include
PRI (photochemical reflectance index)
Intensity of chlorophyll fluorescence
Chlorophyll fluorescence index
Reflectance of state transition, etc
PRI is obtained by converting the spectral reflectance, which varies according to deep oxidation in the lutein cycle, into an exponential form. The lutein cycle is a mechanism for releasing excess light energy that cannot be converted by photosynthesis as heat, such as stomatal closure caused by strong light or water stress.
Here, it is assumed that PRI is calculated by (R570-R531)/(R570+ R531).
Note that "R570" represents the intensity of reflected light having a wavelength of 570nm, and "R531" represents the intensity of reflected light having a wavelength of 531 nm.
The intensity of chlorophyll fluorescence may be an intensity of chlorophyll fluorescence excited by sunlight (solar-induced chlorophyll fluorescence (SIF)). Chlorophyll fluorescence may not be excited by sunlight but by laser or LED.
The chlorophyll fluorescence index is represented by the ratio of two wavelengths (two wavelengths such as 685nm and 735 nm) by measuring chlorophyll fluorescence separately with several wavelengths.
Stress detection can be performed using chlorophyll fluorescence. Chlorophyll fluorescence is produced from plants in association with photosynthesis of vegetation, and is a phenomenon in which, if energy is not extracted from reaction centers of photoexcited electrons for a certain period of time, the energy is emitted as fluorescence having a wavelength of about 680 to 770nm in higher plants.
The emitted energy is 0.5% to 3% of the energy of the input light, varies according to the state of photosynthesis of the plant, and becomes large in the case where the amount of the excessive light energy that cannot be converted by photosynthesis is large (such as stomatal closure caused by water stress or strong light).
As a result of image capturing using the
Therefore, in the case where vegetation change information for time-series observation is generated, it is assumed that extraction of vegetation data is performed based on ratio information.
The object to be observed is vegetation in the
The configuration that has been described in the embodiment is one example.
For example, the
The detection of the total sunlight and the scattered light may be performed only by the ambient
The program according to the embodiment of the present invention causes the CPU51 of the computer device 150 to execute an extraction step (S301) of extracting vegetation data to be used from a data group including vegetation data of a plurality of time points respectively associated with ratio information by using the ratio information as a component.
Alternatively, the program causes the CPU51 of the computer device 150 to execute an extraction step (S301), and a generation step (S302) of generating vegetation variation information indicating time-series variation of vegetation statuses by using the vegetation data extracted in the extraction step.
More specifically, the program causes the CPU51 of the computer device 150 to execute the processing in fig. 13C (fig. 14, fig. 15).
With this program, the
Such a program may be stored in advance in a recording medium included in a device such as a computer device, or in advance in a ROM in a microcomputer equipped with a CPU, or the like. Alternatively, such a program may be temporarily or permanently saved (stored) in a removable recording medium such as a semiconductor memory, a memory card, an optical disc, a magneto-optical disc, or a magnetic disk. Further, such a removable recording medium may be provided as so-called package software.
In addition, such a program may be installed from a removable recording medium into a personal computer or the like, or may be installed from a download site through a network such as a LAN or the internet.
Note that the effects described in this specification are merely examples and thus are not limited. In addition, another effect may be exhibited.
Note that the present technology may also have the following configuration.
(1) An information processing apparatus comprising:
and an extraction unit that extracts at least part of vegetation data from vegetation data at a plurality of time points associated with the ratio information, respectively, based on the ratio information that is the ratio of the components of the ambient light.
(2) The information processing apparatus according to (1), further comprising:
and a generation unit that generates vegetation change information indicating a time-series change of the vegetation data by using the vegetation data extracted by the extraction unit.
(3) The information processing apparatus according to (1) or (2), wherein,
the ratio information is a value of a ratio of a detection value of the direct light to a detection value of the scattered light, or a value of a ratio of a detection value of the total sunlight to a detection value of the scattered light.
(4) The information processing apparatus according to any one of (1) to (3), wherein,
the extraction section performs the following processing: a value excluding the associated ratio information from the vegetation data to be used is determined as vegetation data in the vicinity of a specific value by comparison with a threshold value.
(5) The information processing apparatus according to any one of (1) to (4), wherein,
the extraction section performs the following processing: vegetation data is extracted in which the value of the associated ratio information differs from a specific value by at least a prescribed amount.
(6) The information processing apparatus according to any one of (1) to (5), wherein,
the extraction section performs the following processing: extracting values of the associated ratio information is determined as a plurality of sets of vegetation data close to each other by comparison with a threshold value.
(7) The information processing apparatus according to any one of (1), (2), (3), (5), and (6),
the extraction section performs the following processing: the value of the extraction-associated ratio information is determined as vegetation data in the vicinity of a specific value by comparison with a threshold value.
(8) The information processing apparatus according to any one of (1) to (7), wherein,
the extraction conditions for the extraction process by the extraction section can be variably set.
(9) The information processing apparatus according to (2), wherein,
the generation unit converts the vegetation data extracted by the extraction unit into a value obtained by adjusting the ratio information to a fixed value, and generates vegetation change information using the converted vegetation data.
(10) The information processing apparatus according to any one of (1) to (9), further comprising:
and a vegetation data calculation unit that calculates vegetation data by using the vegetation observation data at each time point.
(11) The information processing apparatus according to (10), wherein,
the vegetation data calculation unit obtains the NDVI value as vegetation data.
(12) The information processing apparatus according to any one of (1) to (11), further comprising:
and a ratio calculation unit that calculates ratio information as a component ratio of the ambient light by using the detected value of the ambient light at each time point in association with the vegetation data at each time point.
(13) The information processing apparatus according to (12), wherein,
the ratio calculation section calculates ratio information by using detection values obtained at the respective light receiving sections by an ambient light sensor including a light receiving section that casts a shadow by a light-shielding body and a light receiving section that is not affected by the light-shielding body.
(14) An information processing method comprising:
the following processing is performed by means of an information processing apparatus: vegetation data to be used is extracted from a data group including vegetation data of a plurality of time points respectively associated with ratio information by using the ratio information as a component ratio of ambient light.
(15) A program for causing a computer apparatus to execute: vegetation data to be used is extracted from a data group including vegetation data of a plurality of time points respectively associated with ratio information by using the ratio information as a component ratio of ambient light.
(16) An information processing system comprising:
an ambient light sensor, comprising: a light receiving unit for projecting a shadow by the light-shielding body and a light receiving unit not affected by the light-shielding body;
a ratio calculation unit that calculates ratio information as a component ratio of the ambient light from the detection values obtained at the respective light receiving units in association with the vegetation data at the respective time points;
an extraction section that extracts vegetation data to be used from a data group including vegetation data of a plurality of time points respectively associated with ratio information by using the ratio information as a component ratio of ambient light; and
and a generation unit that generates vegetation change information indicating a time-series change in vegetation state by using the vegetation data extracted by the extraction unit.
List of reference numerals
An information processing apparatus, 10.
- 上一篇:一种医用注射器针头装配设备
- 下一篇:用于执行光学测定的设备、系统和方法