阅读说明：本技术 用于在环境中定位能量收集装置的方法和设备 (Method and apparatus for locating an energy harvesting device in an environment ) 是由 H·J·M·文森特 G·P·哈泽尔 于 2018-06-01 设计创作，主要内容包括：当将能量收集电子装置放置在诸如房间的环境中时,通过使用基于物理的照明模型模拟来自光源的光与环境中的几何的相互作用,来预测(34)将在环境中的不同位置处可用的光能量的量。然后使用在环境中的不同位置处的光能量的预测量来向用户生成显示(42),该显示指示环境中的位置对于要放置在环境中的光能量收集电子装置的适合性。(When the energy harvesting electronics are placed in an environment, such as a room, the amount of light energy that will be available at different locations in the environment is predicted (34) by simulating the interaction of light from the light source with geometry in the environment using a physics-based lighting model. The predicted amount of light energy at different locations in the environment is then used to generate a display (42) to the user indicating the suitability of the location in the environment for the light energy collecting electronics to be placed in the environment.)

1. A method of identifying a location of a light energy collecting electronic device within an environment, the method comprising the steps of:

providing data representative of a geometry in the environment in which a light source and the light energy collecting electronics are to be located;

simulating, using a physics-based lighting model, interactions of light from the light source with geometry in the environment based on the data representing light source and geometry in the environment; and

using the simulated interaction of the light from the light source with the geometry in the environment to predict an amount of light energy that will be available at different locations in the environment, allowing identification of a location in the environment suitable for the light energy collecting electronics.

2. The method of claim 1, further comprising the steps of: generating the data representing light sources and geometry in the environment by analyzing one or more images of the environment.

3. The method according to claim 2, comprising the steps of: a plurality of images of the environment taken from different viewpoints in the environment and/or under different lighting conditions in the environment are analyzed.

4. The method according to any one of the preceding claims, comprising the steps of:

simulating the interaction of the light from the light source with the geometry in the environment using a modified version of a physics-based lighting model of computer graphics processing for rendering computer graphics images for display.

5. The method of any one of the preceding claims,

the physics-based lighting model also uses as input one or more of: data indicative of weather that can affect natural light in the environment;

data indicating usage of the environment;

data representing geometry outside the environment that may affect natural light sources in the environment;

data representing the geometry of the sun relative to a natural light source of the environment;

data indicating a sunset and a sunrise of the environment; and

data indicative of a path of the sun relative to a natural light source of the environment.

6. The method according to any one of the preceding claims, comprising the steps of:

predicting an amount of light energy to be available at different locations in the environment using a plurality of simulations of the interaction of the light from the light source with the geometry in the environment, each simulation having different lighting conditions and/or corresponding to different times of day or year.

7. The method according to any one of the preceding claims, further comprising the step of:

using the predicted available light energy at the different locations in the environment to provide a display that provides an indication of the suitability of the different locations in the environment for positioning light energy collecting electronics.

8. The method according to any one of the preceding claims, comprising the steps of: displaying a representation of the environment indicating the suitability of different locations in the environment for positioning light energy collecting electronics.

9. The method according to claim 8, comprising the steps of: displaying the representation of the environment indicating suitability of different locations in the environment using augmented reality or virtual reality display technology.

10. The method of claim 7, 8 or 9,

the display indicating the suitability of the different locations in the environment for positioning light energy collecting electronics is based on one or more of:

whether the electronic device is intended to communicate with other electronic devices in the environment;

communication requirements and/or topology of a communication network of which the electronic device is to be a part;

an intended function of the electronic device;

use of the environment;

environmental factors in the environment that can affect operation of the electronic device; and

one or more characteristics of the electronic device.

11. The method according to any one of claims 7 to 10, comprising the steps of:

providing the display on a display screen of a portable electronic device indicating suitability of different locations in the environment for light energy collecting electronics; and is

The method further comprises the steps of:

displaying instructions for setting light energy collection electronics on the display of the portable electronic device.

12. The method according to any one of the preceding claims, further comprising the step of:

once the light energy collecting electronics are placed in the environment, their location is identified and recorded.

13. A method of installing a light energy collecting electronic device in an environment using a portable electronic device, the method comprising the steps of:

an application on the portable electronic device, by way of a display on the portable electronic device, instructing a user of the portable electronic device to take one or more images of an environment in which a light energy collecting electronic device is to be installed using a camera of the portable electronic device and providing the one or more images of the environment to an image analysis engine that is operatively capable of analyzing images of the environment to generate data representative of light sources and geometry in the environment;

the image analysis engine analyzing the captured image of the environment to generate data representative of the light source and geometry in the environment in which the light energy collection electronics are to be installed and providing the data representative of the light source and geometry in the environment to a processor that is operable to simulate the interaction of light from the light source with geometry in the environment using a physics-based lighting model;

the processor being operable to simulate the interaction of the light from the light source with the geometry in the environment based on the generated data representing the light source and the geometry in the environment using the physics-based lighting model, and to provide data indicative of the simulated interaction of the light from the light source with the geometry in the environment to a processor operable to predict an amount of light energy to be available at different locations in the environment using the data indicative of the simulated interaction of the light from the light source with the geometry in the environment;

the processor being operatively capable of predicting the amount of light energy that will be available at different locations in the environment using the simulated interaction of light from the light source with geometry in the environment, and based on the predicted amount of light energy that will be available at different locations in the environment, providing data to the application on the portable electronic device for providing a display on the display of the portable electronic device that indicates the suitability of a location in the environment for installing the light energy collecting electronic device; and

the application on the portable electronic device provides a display on the display of the portable electronic device indicating the suitability of a location in the environment for installing the light energy collecting electronic device based on the data for providing a display on the display of the portable electronic device indicating the suitability of a location in the environment for installing the light energy collecting electronic device.

14. An apparatus for identifying a location of light energy collecting electronics within an environment, the apparatus comprising:

at least one processor configured to:

simulating, using a physics-based lighting model, interactions of light from a light source with geometry in an environment based on data representing the light source and the geometry in the environment;

and is

Using the simulated interaction of the light from the light source with the geometry in the environment to predict the amount of light energy that will be available at different locations in the environment, allowing for identification of locations in the environment suitable for light energy collecting electronics.

15. The device of claim 14, wherein the at least one processor is further configured to:

generating the data representing light sources and geometry in the environment by analyzing one or more images of the environment.

16. The device of claim 15, wherein the at least one processor is configured to:

generating the data representing light sources and geometry in the environment by analyzing a plurality of images of the environment taken from different viewpoints in the environment and/or under different lighting conditions in the environment.

17. The device of any of claims 14-16, wherein the at least one processor is further configured to:

simulating the interaction of the light from the light source with the geometry in the environment using a modified version of a physics-based lighting model of computer graphics processing for rendering computer graphics images for display.

18. The apparatus of any one of claims 14 to 17,

the physics-based lighting model also uses as input one or more of:

data indicative of weather that can affect natural light in the environment;

data indicating usage of the environment;

data representing a geometry outside the environment that can affect a natural light source in the environment;

data representing the geometry of the sun relative to a natural light source of the environment;

data indicating a sunset and a sunrise of the environment; and

data indicative of a path of the sun relative to a natural light source of the environment.

19. The device of any of claims 14-19, wherein the at least one processor is further configured to:

predicting an amount of light energy to be available at different locations in the environment using a plurality of simulations of the interaction of the light from the light source with the geometry in the environment, each simulation having different lighting conditions and/or corresponding to different times of day or year.

20. The device of any of claims 14-19, wherein the at least one processor is further configured to:

using the predicted available light energy at the different locations in the environment to provide a display that provides an indication of the suitability of the different locations in the environment for positioning light energy collecting electronics.

21. The device of any of claims 14-20, wherein the at least one processor is further configured to:

displaying a representation of the environment indicating the suitability of different locations in the environment for positioning light energy collecting electronics.

22. The device of claim 21, wherein the at least one processor is further configured to:

displaying the representation of the environment indicating suitability of different locations in the environment using augmented reality or virtual reality display technology.

23. The apparatus of claim 20, 21 or 22,

the display indicating the suitability of the different locations in the environment for positioning light energy collecting electronics is based on one or more of:

whether the electronic device is intended to communicate with other electronic devices in the environment;

a communication requirement and/or topology of a communication network of which the electronic device is a part;

an intended function of the electronic device;

use of the environment;

environmental factors in the environment that can affect operation of the electronic device; and

one or more characteristics of the electronic device.

24. The device of any of claims 20-23, wherein the at least one processor is further configured to:

providing the display on a display screen of a portable electronic device indicating suitability of different locations in the environment for light energy collecting electronics; and is

Wherein the processor is further configured to:

displaying instructions for setting light energy collection electronics on the display of the portable electronic device.

25. The device of any of claims 14-24, wherein the at least one processor is further configured to:

once the light energy collecting electronics are placed in the environment, their location is identified and recorded.

26. A system for installing light energy collecting electronics in an environment, the system comprising:

a portable electronic device, the portable electronic device comprising:

a camera;

a display;

a memory;

a processor, the processor being operatively capable of executing an application; and

a graphics processing unit;

the system further comprises:

an image analysis engine operable to analyze an image of an environment to generate data representative of a light source and geometry in the environment;

a physics-based lighting model engine operable to simulate an interaction of light from a light source with geometry in an environment using a physics-based lighting model based on data representing the light source and the geometry in the environment;

a light energy prediction engine operable to predict an amount of light energy that will be available at different locations in the environment based on simulated interaction of light from the light source and geometry in the environment from the physics-based lighting model engine; and

a display data generation engine operable to generate data for providing a display on the portable electronic device based on the predicted amount of light energy from the light energy prediction engine to be available at different locations in the environment, the display indicating a suitability of a location in the environment for installing light energy collecting electronic devices;

wherein the content of the first and second substances,

the processor of the portable electronic device is operable to execute an application operable to:

directing, by means of a display on the portable electronic device, a user of the portable electronic device to take one or more images of an environment in which a light energy collecting electronic device is to be installed using a camera of the portable electronic device and provide the one or more images of the environment to the image analysis engine, which is operatively capable of analyzing images of the environment to generate data representing light sources and geometry in the environment;

and is

Providing a display on the display of the portable electronic device indicating the suitability of a location in the environment for installing the light energy collecting electronic device based on the data for providing a display on the display of the portable electronic device indicating the suitability of a location in the environment for installing the light energy collecting electronic device.

27. A computer program comprising computer software code for performing the method according to any of claims 1 to 13 when the program element is run on a data processor.

Drawings

Various embodiments of the technology described herein will now be described, by way of example only, and with reference to the accompanying drawings, in which:

fig. 1 schematically illustrates an internet of things device;

FIG. 2 schematically illustrates an exemplary indoor environment;

FIG. 3 schematically illustrates operations in an embodiment of the techniques described herein;

FIG. 4 schematically illustrates predicted availability of light energy at different locations in an environment;

fig. 5 schematically illustrates an embodiment of a visual display of an indoor environment indicating the suitability of different locations in the indoor environment for light energy collecting electronics;

FIG. 6 schematically illustrates a portable electronic device that may be used to implement the embodiments; and

FIG. 7 schematically illustrates operation of the portable electronic device shown in FIG. 6 in an embodiment of the techniques described herein.

Like reference numerals are used for like parts throughout the drawings where appropriate.

DETAILED DESCRIPTIONS

A first embodiment of the technology described herein includes a method of identifying a location of an optical energy collecting electronic device within an environment, the method comprising the steps of:

providing data representative of the geometry in the environment in which the light source and light energy collecting electronics are to be located;

simulating, using a physics-based lighting model, interactions of light from the light source with geometry in the environment based on data representing the light source and the geometry in the environment; and

the simulated interaction of light from the light source with the geometry in the environment is used to predict the amount of light energy that will be available at different locations in the environment, allowing the location of suitable light energy collection electronics in the environment to be identified.

A second embodiment of the technology described herein includes an apparatus for identifying a location of a light energy collecting electronic device within an environment, the apparatus comprising:

a processor configured to:

simulating, using a physics-based lighting model, interactions of light from the light source with geometry in the environment based on data representing the light source and the geometry in the environment;

and is

The simulated interaction of light from the light source with the geometry in the environment is used to predict the amount of light energy that will be available at different locations in the environment, allowing the location of suitable light energy collection electronics in the environment to be identified.

The techniques described herein use a physics-based lighting module to simulate the geometrical interaction of light with light energy collecting electrons, for example, in an indoor environment. The simulation is then used to predict the amount of light energy that will be available at different locations in the environment. This may then allow identification of the appropriate location of the light energy collecting electronics within the environment (e.g., and in embodiments, based on the light energy requirements needed to power the device).

Applicants have recognized, among other things, that a physics-based lighting module may be used to simulate the interaction of light within an environment, and thus may be used to predict the amount of light energy that will be present at different locations within the environment. This may then facilitate the placement of light energy collecting electronics (such as internet of things nodes) within the environment to (attempt to) ensure that they will receive sufficient light energy for their power requirements. This is advantageous because it may provide a more accurate positioning of the optical energy harvesting electronics in the environment than may be based more on conventional techniques such as "trial and error".

Moreover, as will be discussed further below, techniques in the technology described herein may be capable of considering a broader number of environments and other factors to allow for more appropriate positioning of electronic devices within the environment.

The light energy collecting electronics to identify a location may be any suitable and desirable electronics with light energy (solar) collecting capabilities. The light energy collection capability of the device may be provided in any suitable and desirable manner, for example and in embodiments, by using suitable photovoltaic cells.

The electronic device in embodiments has an internal power source, such as a battery pack, for example and in embodiments, the power source is charged by light energy collection.

In an embodiment, the electronic device has suitable processing capabilities, suitable storage (such as memory) and communication capabilities to allow it to communicate (wirelessly in an embodiment) with other electronic devices. In an embodiment, the electronic device is an internet of things device (node).

The electronic device may have any suitable and desired functionality and operation, such as, for example, acting as a sensor (e.g., for temperature, pressure, movement or other environmental factors, or plant maturity/growth/life cycle, disease signs, for example), or otherwise. In an embodiment, the electronic device generates a data stream that it can provide to a "centralized" control system.

The environments contemplated in the technology described herein may include any suitable and desirable environment. In an embodiment, the environment includes a suitable space (volume) within which the electronic device is located. In an embodiment, the environment comprises an indoor environment, such as and in an embodiment, a room (within a building) (although it may also comprise a group of multiple rooms, buildings, etc., if desired).

The light source in the environment under consideration may be any suitable and desired light source. Thus, the light source may comprise artificial and/or natural light sources, such as and in embodiments, artificial lights as well as windows or other apertures through which natural light may enter, for example, an indoor environment. In an embodiment, a plurality of light sources in the environment are considered, and in an embodiment, all potential light sources in the environment are considered.

Correspondingly, the geometry in the environment considered may be any suitable and desired geometry of the environment.

The geometry considered in an embodiment comprises, for example, a surface within an indoor environment, and in an embodiment is a plurality of surfaces, and in an embodiment is each surface, in an environment that can interact with light within the environment. The geometry also or instead and in embodiments also includes geometries corresponding to a plurality (and in embodiments all) of objects that may interact with light in the environment. Thus, the geometry may, and in embodiments does, for example, include boundaries of an indoor environment (e.g., walls, floors, and ceilings) and, for example, one or more (and in embodiments all) objects within the indoor environment.

The data representing the geometry in the light source and the environment may comprise any suitable and desirable such data which may represent the light source or the geometry.

In the case of a light source, the data representing the light source indicates in an embodiment at least one (and in embodiments a plurality, and in embodiments all) of: the type of light source (e.g. whether it is natural light or artificial light, and at least in the case of artificial light, the type or nature of artificial light); the size of the light source; the location of the light source in the environment; the light output (e.g., and in embodiments, in terms of its intensity, color, and/or spectrum) of the light source; and any other (e.g., material) characteristics of the light source that can control (e.g., and in embodiments) the dispersion of light from the source and the amount and nature of the light energy that the light source will provide. A standardized light profile (e.g., IES light curve) may be used for this purpose.

In the case of a geometry (e.g. representing a surface and/or an object), the data representing the geometry comprises in an embodiment one or more (and in an embodiment all) of: the position of a geometry (e.g., a surface or an object) in the environment; the dimensions of the geometry in question in the environment; any (e.g. surface) characteristics of the dispersion of light that would affect the geometry falling in the environment, such as a measure of the reflectivity and/or the absorbance of light by the geometry, etc. The data representing the geometry may, and in embodiments does, also include (e.g. 3D) models and/or predictions of how the object changes over time. This may be appropriate in situations where the object is to change over time, such as when considering plants growing in the environment in question.

The data representing the geometry in the light source and the environment may be provided in any suitable and desirable way.

In one embodiment, this data is provided as a suitable environmental model (e.g., and in one embodiment, a 3D environmental model). Such a model may be generated to represent, for example, the design of an environment (e.g., a room) and/or building in which the electronic device is intended to be used. Such a model may be computer-generated, for example as a CAD design or otherwise generated. Thus, data may be provided from, for example, an appropriate design tool or pipeline.

In an embodiment, data representing the light source and the geometry in the environment is captured from the environment itself (generated from an analysis of the actual environment in question). In this case, in an embodiment, the data is generated from one or more images of the environment itself. For example and in an embodiment, one or more (and in an embodiment multiple) photographs of the environment in question may be captured and then analyzed to generate data representing the light source and the geometry in the environment.

Thus, in embodiments, the techniques described herein include taking one or more images of an environment and analyzing the images to derive data representing the light sources and the geometry in the environment, which is then used in a physics-based lighting module to simulate the interaction of light in the environment.

The image of the environment used may comprise, for example, a photograph of the environment and/or a video of the environment.

In these configurations, in an embodiment, multiple images of the environment are captured, for example and in an embodiment, from different viewpoints (and viewing directions) in the environment.

In an embodiment, the images are also or instead (and in an embodiment are also) captured under different lighting conditions in the environment. For example, an image may be captured without artificial lighting and with some or all of the artificial lighting turned on in the environment.

In an embodiment, images are captured for a plurality (and in an embodiment each) of the different lighting combinations possible in the environment. For example, in case there are multiple artificial light sources, this can be achieved by: a first set of images is taken with one artificial light source on, a second set of images is taken with a different artificial light source on, and so on until all artificial light sources have been considered. It would also be possible to take multiple sets of images for different combinations of artificial light sources if desired. It would also be possible to take multiple sets of images, if desired, for example for different times of the day, to allow for variations in the day, for example, of natural light sources.

For example, it would also be possible to take a picture of the environment with and without the use of a flash, as this may provide additional information about the way the light will interact with the environment (e.g. in terms of reflectivity and surface characteristics of the object, etc.). If desired, data representing the intensity of the flash used in taking a picture of the environment will also be available as part of analyzing the environment from the picture.

In an embodiment, the geometry in the environment is analyzed using images where all light sources are active.

In an embodiment, an image of an environment is captured by a user wishing to place an electronic device in the environment. The user may do this, for example, using a camera, for example, on their phone or another portable electronic device. In an embodiment, the resulting photograph or video is then provided to a suitable analysis engine that is capable of analyzing the image to generate data representative of the light source and the geometry in the environment.

In an embodiment, the user may be guided, and in an embodiment is, about which images of the environment are to be taken, e.g. in view of different views of the environment and different lighting conditions under which the images of the views are taken. This may be indicated, for example, by appropriate display to the user on their device.

The image of the environment may be analyzed in any suitable and desirable way to derive data representing the light source and the geometry in the environment. For example, the image may, and in embodiments is, used to determine the location, size, type, etc. of the light source and the geometry (e.g., object, wall, floor, surface, etc.) in the environment. The images may also be analyzed in an attempt to assess other (e.g., material) characteristics of objects and surfaces in the environment (e.g., characteristics that would or may affect the dispersion of light falling on such objects and surfaces, such as their reflectivity, reflection, etc.).

Image analysis to determine appropriate light sources and geometric data may be performed in any suitable and desired manner, for example using any suitable and desired image analysis techniques, such as object recognition techniques and the like. For example, a reference image and a database of corresponding light sources and geometric (e.g., surface) attributes may be used to identify characteristics of the light sources and geometry in the environment from the environment image. For example, machine learning techniques will also be available to improve the analysis of environmental images over time.

It will also be possible to allow the user to feed (appropriate) parameters and data into the environment model/analysis, if desired.

A combination of the captured environmental image and a modeling (e.g., computer generated model) of the environment (or environmental elements) would also be used if desired.

The physics-based lighting model may simulate the interaction of light from the light source with the geometry in the environment in any suitable and desired manner. In an embodiment, the model is operable to predict light intensity (with some desired accuracy) over time for a location in the environment. In an embodiment, the model is operable to predict how light from the light source will fall on objects and surfaces in the environment based on data representing the geometry of the light source and the environment. In an embodiment, the model is operable to identify whether surfaces or objects (geometry) in the environment are in shadow.

Any suitable and desirable physics-based lighting model that can simulate the interaction of light with geometry in the environment may be used for this purpose. However, in an embodiment, a physics-based lighting model for determining lighting effects in graphics processing (computer graphics processing) is used for this purpose. Thus, in an embodiment, a physics-based lighting model (engine) for rendering computer graphics images for display (e.g. in a computer game (game engine)) is used to simulate the interaction of light from a light source with geometry in an environment.

The applicant has realised in this regard that a model for simulating scene lighting when rendering a view of a scene for display in graphics processing may also (and advantageously) be used to simulate the interaction of light from a light source with geometry in an environment in order to predict the amount of light that will be received at different locations in the environment. Thus, the use of such a graphically processed, physically processed based lighting model may be advantageously used in the context of the techniques described herein, i.e., to assist in predicting the amount of light energy that will be available at different locations in the environment in order to identify the appropriate location of the light energy collecting electronics within the environment.

Any suitable graphics-processing, physics-based lighting model may be used for this purpose.

In an embodiment, a modified version of a graphics-processing, physical-based lighting model is used in the techniques described herein, wherein the graphics-processing lighting module is adapted to take into account the light-energy collection characteristics of the device in question (e.g., and in embodiments, is configured to be suitable for use with photovoltaic cells, rather than simply using, for example, an RGB model for aiming at the (typical) human eye, which may be used in the graphics-processing lighting model when rendering images for display). Thus, in an embodiment, based on data representing the geometry in the environment and the light source, the interaction of the light from the light source with the geometry in the environment is simulated using a physics-based lighting model adapted from a graphics processing lighting model.

In addition to using data representing light sources and geometry in the environment, the physics-based lighting model may also, and in embodiments does, use other data that may be relevant to the lighting in the environment when simulating the interaction of light from the light sources with the geometry in the environment. Such additional data may be any suitable and desirable data relating to factors that may affect the lighting in the environment.

In one embodiment, the further data used comprises data representing geometry outside the environment, such as the geometry of buildings and/or geographical features such as mountains, which may affect natural light sources (e.g. windows) in the environment. This is done in embodiments where the environment includes a natural light source, such as a window.

In embodiments where the environment includes a natural light source, such as a window, the physics-based lighting model also uses as input data representing the geometry of the sun and/or data representing the path of the sun relative to the environment (e.g., and in embodiments, relative to a natural light source in the environment, such as a window). The data relating to the path of the sun may include, for example, data indicative of the sunset and sunrise of the environment, and/or more complex data indicative of the path of the sun relative to the natural light sources of the environment.

In an embodiment, the physics-based lighting model also uses as input one or more (and in an embodiment all) of the following: data indicative of weather that may affect natural light in an environment (wherein the environment includes natural light sources); and data indicative of usage of the environment, for example and in embodiments, in relation to how such usage may affect use (e.g. usability) of the light source (whether natural or artificial) in the environment.

Other configurations would of course be possible.

Simulations of the interaction of light from a light source with geometry in an environment may be used to predict the amount of light energy that will be available at different locations in the environment in any suitable and desirable way. In an embodiment, the amount of light energy to be available is predicted for a plurality of different locations in the environment.

The location in the environment where the amount of light energy to be available is predicted may be any suitable and desirable location in the environment. In an embodiment, they are at least suitable for locating the position of the electronic device in question.

In an embodiment, the different locations in the environment comprise different locations on a surface in the environment, such as and in an embodiment, locations on a wall and/or ceiling or floor of the environment. Thus, in an embodiment, the amount of light energy that would be available at different locations on at least one (and in an embodiment a plurality, and in an embodiment each) surface in the environment on which the electronic device may be mounted is determined.

Correspondingly, in an embodiment, each location in the environment where the amount of light energy to be available is predicted comprises a respective area of a surface (such as a wall), for example and in an embodiment in the environment.

In one embodiment, a surface in the environment (such as a wall, ceiling and/or floor) is divided into individual smaller regions (sub-regions), and simulations of the interaction of light from the light sources with the geometry in the environment are used to predict the amount of light energy (in embodiments in terms of the amount of light flux) that will be available on and for the individual (and in embodiments a plurality and in embodiments each) sub-regions divided from the surface in the environment under consideration.

In this regard, a surface sub-region may include any suitable and desired smaller region of the surface in question, such as a region having sides of a few centimeters up to a few tens of centimeters (e.g., a rectangle or square). For example, a 10cm × 10cm area may be considered. The size of the area may for example be based on the size of the electronic device in question.

In an embodiment, the amount of light energy available from the light source is predicted for a plurality of (sampled) positions of a grid of sampled (data) positions representing surfaces in the environment, such as walls, ceiling and/or floor. In this case, the resolution of the data (sampling) location grid may be selected as desired (e.g., based on the environment in question and/or the size of the electronic device).

The simulated interaction of light from the light source with the geometry in the environment may be used to predict the amount of light energy that will be available at different locations in the environment in any suitable and desirable manner. In an embodiment, the simulation is used to predict (determine) a measure of luminous flux falling on different locations in the environment. This may be done in any suitable and desirable way, e.g. by summing the total amount of luminous flux from all light sources falling on the position in the environment based on simulated interaction of the light from the light sources with the geometry.

It will be possible to simulate the interaction of light from a light source with the geometry of the environment for a set of lighting conditions, and then use this simulation to predict (and as a measure of) the amount of light energy that will be available at different locations in the environment (and in one embodiment, to do so).

However, in an embodiment, multiple simulations of the interaction of light from a light source with geometry in the environment are determined, each simulation having different lighting conditions, and the results of these simulations are then combined (in an appropriate manner) to provide predictions of the amount of light energy that will be available at different locations in the environment.

For example, in an embodiment, a simulation is performed that represents lighting conditions at different times in the environment over a particular (in an embodiment, selected) period of time (such as, in an embodiment, a day (24 hours), during working hours, etc.), and then appropriately combined (e.g., summed) to provide a measure of the amount of light energy that will be received at different locations in the environment over the period of time in question (e.g., over 24 hours). In this case, in an embodiment, the simulation of the interaction of the light from the light source with the geometry in the environment takes into account factors that will vary during the period of time in question (e.g. during the course of a day), such as the availability and location of natural light in the environment and the availability of artificial light sources in the environment. For example, the analysis of natural light sources (e.g., windows) may also be configured to account for weather conditions, the presence and location of the sun, etc., at different times during a time period (e.g., a day), as desired.

If desired, variations in lighting conditions over a period of more than one day (such as over several months or the entire year) will also be considered (and in embodiments, will do so). In this case, in an embodiment, the simulation of the lighting conditions also takes into account any changes in lighting conditions that occur during the (longer) time period in question (e.g. a year), such as natural light source variability caused by seasonal variations and/or by changing use of the environment during the time period in question (e.g. months or a year). This would then allow for the prediction of the light energy received at different locations in the environment over a longer period of time for use in attempting to identify a suitable location for the electronic device in question.

Thus, in an embodiment, a plurality of simulations of the interaction of light from a light source with geometry in an environment are determined to account for (and simulate) the propagation of light from the light source over a given period of time, such as the course of a day and/or across seasons.

Thus, in embodiments, the techniques described herein include: the physical-based lighting model is used to simulate the interaction of light from the light source with the geometry in the environment for a plurality of different lighting conditions, such as and in embodiments, at different times during a particular and in embodiments, a selected overall time period, such as a day or a year, and then the plurality of simulations are used to predict the amount of light energy that will be available at different locations in the environment.

Where multiple light interaction simulations are generated, then they may be used to predict the amount of light energy that will be received at different locations in the environment in any suitable and desirable manner.

For example, the lowest amount of light at each different location across a set of simulations may be determined and used as the amount of light energy that will be available at the location in question.

In an embodiment, multiple simulations are combined in some manner to provide a prediction of the amount of light energy that will be available at different locations in the environment. In this case, the sum (total) of the light energies from each simulation (or from a selected subset of simulations) in a set of simulations may be used as a measure of the amount of light energy that will be available at different locations in the environment, and/or each or a subset of simulations may be averaged to provide an average amount of light energy that will be available at different locations in the environment.

In an embodiment, the distribution of the luminous flux at the location (e.g. surface) in question over time is determined. In an embodiment, the integral of the luminous flux per unit area (at a given location) over the time period in question is determined.

Other configurations would of course be possible.

Once the amount of light energy that will be available at different locations in the environment has been predicted, this information can be, and in embodiments is, used to identify locations suitable for light energy collecting electronics in the environment. This may be done in any suitable and desirable way.

In an embodiment, representations of available light energy (e.g., luminous flux) at different locations in the environment are presented (e.g., and in an embodiment displayed) to a user, allowing the user to identify locations appropriate for electronic devices in the environment.

Thus, in an embodiment, the techniques described herein further include: a display is provided indicating the predicted amount of light energy that will be available at different locations in the environment, allowing identification of locations suitable for light energy collecting electronics in the environment.

The predicted amount of light energy may be displayed in any suitable and desirable form. For example, the distribution of light energy (e.g., luminous flux) available at a given location in the environment may be displayed, for example, to allow a user to identify the amount of light energy that will be received at different locations.

For example, a list of locations may also be provided with their measures of predicted light energy to allow identification of possible locations for the electronic device.

In an embodiment, the predicted available light energy at different locations is displayed by providing an indication of the available amount of light energy that has been predicted on the image of the local environment itself. In an embodiment, the predicted available light energy at different locations is used to provide a display that provides an indication of the suitability of the different locations in the environment for locating the electronic device.

For example and in an embodiment, this may be provided in the form of a "color" or "heat map" that is placed over the image of the local environment indicating the amount/suitability of light energy predicted at different locations in the image of the local environment. This would then more directly facilitate the user identifying the appropriate location in the environment for the electronic device.

In such an embodiment (or otherwise), the predicted available light energy at different locations in the environment is compared to one or more "light energy" thresholds and then a display is set to indicate which locations have light energy availability that exceeds or does not exceed a given threshold.

In an embodiment, thresholds are used indicating "minimum", "some", and "sufficient" energy availability/suitability.

For example, there may be a first threshold value representing a predicted amount of light energy that will be sufficient to power the electronic device and another threshold value indicating a predicted amount of light energy that will certainly not be sufficient to power the electronic device, then different locations are indicated according to whether their predicted amount of available light energy is greater than or less than the respective threshold value.

For example, if the predicted amount of light energy at a location is above a threshold that will affirmatively provide sufficient light energy to power the device, the location may be indicated using a first color (e.g., green), and if the predicted amount of light energy is below the threshold that indicates that the amount of energy is affirmatively less than the energy required to power the device, the location is shown in another color (e.g., red). Any area where the predicted amount of light energy falls between the two thresholds may be shown in a third color (e.g., yellow).

In these configurations, the respective light energy thresholds may be set as desired, for example and in embodiments, depending on the electronics under consideration (in particular depending on their (known) power requirements).

Thus, in the embodiment, the display operation is to indicate a position that is good for positioning the electronic device (conversely, a position that is "bad").

For example, a display representing the amount of energy to be received at different locations in the environment may be stored for later use.

In an embodiment, this is displayed to the user so that the user may use the display when placing the electronic device in the environment. In an embodiment, a representation of the amount of light energy that will be available/suitable at different locations in the environment is displayed to the user using Augmented Reality (AR) or Virtual Reality (VR) display technology. This would then allow the user to more directly identify the appropriate location of the electronic device in the environment and, as will be discussed further below, to install the electronic device in the environment in a more interactive manner.

Thus, in embodiments, the techniques described herein include: a representation of the environment is displayed using augmented reality or virtual reality display technology, the representation indicating a predicted amount of light energy that will be available/suitable at different locations in the environment. In an embodiment, this is done using a head mounted display.

In an embodiment, in addition to considering the predicted amount of light energy that will be available/suitable at different locations in the environment, the display indicating the suitability of different locations in the environment for the electronic device also considers and is based on one or more other factors in addition to the predicted amount of light energy that may affect the suitability of a location in the environment for the electronic device.

In this regard, any suitable and desired factor or criteria that may affect the suitability of a location in an environment for an electronic device may be considered.

In embodiments where the electronic device is intended to communicate with other electronic devices in the environment (e.g. as part of an internet of things network), then in embodiments communications with other electronic devices are taken into account in indicating the suitability of a location in the environment for the electronic device.

In an embodiment, this takes into account, for example, network communication requirements and/or topology of the communication network (mesh) of which the electronic device is to be a part. This may take into account, for example, any necessary proximity to other electronic devices in the environment for communication purposes, the transmit power and/or receive sensitivity of the devices, and so forth.

For example, the elasticity of electronic devices acting as nodes in a communication network may also be considered.

In an embodiment, presentation of the suitability of the location in the environment for the electronic device also takes into account (and is based on) one or more (and in embodiments a plurality, and in embodiments all) of: the intended function of the electronic device (e.g., its sensor function); (known or predicted) usage of the environment (e.g., in terms of usage (working) patterns and locations in the environment); any environmental factors in the environment that may affect the operation of the electronic device (such as temperature); and any special practical factors that may affect the positioning of the electronic device in the environment.

In an embodiment, the display indicating the suitability of a location in the environment for the electronic device also takes into account and is based on one or more characteristics of the electronic device, such as its light energy collection capability (photovoltaic characteristics, e.g., the size of its solar panel), the capacity of the internal power source (e.g., a battery pack), whether it can also receive mains power; the intended function of the device; and the like.

In an embodiment, the process also takes into account any known predicted aging characteristics of the electronic device, for example, in terms of the effect of aging on the battery pack and/or photovoltaic cells of the device over time.

In embodiments, the process also takes into account battery pack charge/depletion cycles of the electronic device, and for example and in embodiments, takes into account the interaction of light availability at locations in the environment with battery pack charge/depletion cycles.

In this regard, in addition to using the predicted amount of light energy that will be available at different locations in the environment to identify a suitable location of an electronic device in the environment, the predicted amount of light energy will also be usable to select an electronic device to be used in the environment (e.g., based on the predicted amount of light energy and what form of device will be able to operate using that predicted amount of light energy). Thus, in embodiments, the pre-measured amounts of light energy to be available at different locations in the environment are also used to select electronic devices to be used in the environment, for example and in embodiments from a set of multiple electronic devices. Also or instead, the predicted amount of light energy will be used to select or set appropriate parameters of the electronic device, such as to select the size of the battery pack and/or photovoltaic cell to be used with the device, whether or not the device should be connected to a mains power supply, or the like.

In an embodiment, the display of the suitability of a location in the environment for an electronic device is used to guide a user in the environment itself to assist the user in locating and installing the electronic device in the environment. As described above, in embodiments this is achieved by displaying information to a user indicating the suitability of the location of the electronic device in the environment using an augmented reality or virtual reality display (representing the environment) in embodiments.

Thus, in an embodiment, there is thus an interactive display process that indicates to the user the appropriate location of the electronic device, which is then guided by the display to place the device in the environment.

In this case, in embodiments, in addition to providing guidance to a user in the environment for installing the electronic device in the environment, the system is also operable to provide and install the electronic device in the environment itself. This may also include, for example: the user is instructed to place the device in the appropriate location in the environment and then, via the display, instructs the user to set up the device (to activate the device) for the first time. This may include, for example, instructing the user to perform an appropriate initialization input to the electronic device, and/or providing some form of input or signal to the electronic device to activate it, for example, from a device for displaying location indication information to the user. Such a signal may include, for example, a user or automatically triggering a flash on the user device to activate the electronic device once the electronic device is located.

In an embodiment, the process is also operable to identify and record the location of the device once the device is placed in the environment. This may be done as desired. For example, the device itself may be triggered to transmit its location to an appropriate control device of the system (e.g., a network) of which the electronic device is to be a part.

In an embodiment, a device that displays to a user the suitability of a location for an electronic device is also used and is operable to record and identify the location of the device in an environment once the device is placed in the environment. This can be achieved, for example, by: once the device is installed in the environment, the user is caused to take an image (e.g., a photograph) of the device, which is then appropriately analyzed to identify the location of the device in the environment. It will also or instead be possible that a display indicating the location of the environment may be interacted with by a user such that once the apparatus is placed in the environment via the display, the user can interact with the display, for example, to indicate the location of the apparatus.

Although the techniques described herein have been described above primarily with reference to identifying a location in an environment suitable for a given electronic device, as will be appreciated by those skilled in the art, the techniques described herein may be used with any desired number of electronic devices that may be desired to be placed in an environment.

In such a case, the pre-measured amount of light energy may be, and in embodiments is, used to identify a location suitable for a plurality of electronic devices (e.g., for each device desired to be placed in the environment).

In this case, as the device is placed in the environment, the display of the suitability of the location for the electronic device may be modified in an iterative manner to indicate the suitable location of any remaining devices to be placed based on the placement of other devices in the environment. Correspondingly, in an embodiment, the display adapted to the location of the electronic device takes into account any desired relationship (e.g. communication) between the plurality of electronic devices to be placed in the environment.

For example, the predicted availability/suitability of light energy in the environment may also be used in conjunction with a network topology planning/optimization process (e.g., algorithm) to plan or select, for example, a grid of electronic devices or a number of nodes in the network, e.g., based on the predicted availability/suitability of light energy in the environment, if desired.

The methods and apparatus of the techniques described herein may be implemented in any suitable and desirable way and are suitable for and may be used in any data processing system.

In embodiments, they are implemented by means of a suitable application, executing on a processor of, for example (and in embodiments, a data processing system).

The device and/or data processing system may, and in embodiments do, further include one or more, and in embodiments all, of a central processing unit (host processor), a graphics processing unit, a display controller, a system bus, a memory controller, a display, and a memory. In an embodiment, the memory includes a main memory of the entire data processing system (e.g., a main memory shared with a Central Processing Unit (CPU)). The display may be any suitable and desired display, such as a screen. The display may include a local display (screen) and/or an external display of the entire data processing system (device).

In embodiments, the device and/or data processing system includes and/or is in communication with one or more memories and/or storage devices that store data described herein and/or software for performing the processes described herein.

The techniques described herein may be implemented, for example, using a personal computer that is, for example, operatively capable of receiving and/or generating data representing light sources and geometry in the environment, then executing a physics-based lighting model and predicting the amount of light energy that will be available at different locations in the environment, and then providing an appropriate display to a user, for example, on a display screen, to assist the user in identifying the appropriate location of light energy collection electronics in the environment.

In embodiments, the techniques described herein are provided at least in part on and implemented by a portable electronic device, such as a mobile phone or tablet computer. In such cases, the techniques described herein may be, and in embodiments are, implemented by means of a suitable application executing on a portable device (e.g., a mobile telephone) that is operatively enabled to perform one or more or all of the steps and stages of the techniques described herein.

In this case, all operations of embodiments of the techniques described herein (such as analyzing a view of the environment to generate data representative of the light sources and the geometry in the environment, executing the physics-based lighting module to simulate the interaction of light with the geometry in the environment, and then generating therefrom a prediction of the amount of light energy available at different locations in the environment) may be performed entirely on the portable electronic device itself (e.g., where the electronic device has processing power and resources to do so), for example.

Thus, in this case, the application is operable in embodiments to guide a user to take an appropriate view of the environment using a camera of the portable electronic device, and then to generate data representing the light source and the geometry in the environment using an image analysis engine executing on the portable electronic device that is operable to analyze the view of the environment.

In an embodiment, the application is then operable to use a physics-based lighting model (and/or to cause the model to be executed, for example, by a graphics processing unit (graphics processor) of the portable electronic device) to simulate the interaction of light from the light source with the geometry in the environment, then to generate therefrom a prediction of the amount of light energy that will be available at different locations in the environment, then to generate from the prediction an appropriate display indicating the suitability of the locations in the environment for the light energy collecting electronic device.

Alternatively, applications executing on a portable device (e.g., a mobile phone) are able to operatively communicate and receive relevant data to and from remote processors (e.g., servers) in communication therewith (e.g., via the internet or another data network), which then, for example and in embodiments, in response to data received from applications on the portable device, perform more processing-intensive operations of the techniques described herein (such as image analysis, physics-based lighting models, and light energy prediction), and then appropriately return information to the applications on the portable device to facilitate proper display and interaction therewith to a user of the portable device (and, in embodiments, do so).

Thus, an application executing on a portable device may, and in embodiments does, use a remote server (such as a "cloud-based" process) to perform some processing operations, such as the more complex and processing-intensive operations of the techniques described herein. In this case, therefore, the entire processing of the techniques described herein will be performed by and implemented in the portable electronic device and one or more remote processors in communication with the portable electronic device.

In this case, the application in an embodiment is operable to instruct the user to take an appropriate view of the environment using the camera of the portable electronic device, and then send the picture to an image analysis engine executing on a remote processor (e.g., a server), which is then operable to analyze the picture of the environment to generate data representing the light sources and the geometry in the environment.