Information system for construction machine
阅读说明:本技术 用于工程机械的信息系统 (Information system for construction machine ) 是由 约翰·亚伦格里普 于 2017-06-09 设计创作,主要内容包括:本公开总体上涉及一种用于工程机械(100)的信息系统(200),该信息系统特别适合基于与工程机械(100)的周围环境有关的施工数据将图像(206)投影到工程机械(100)外部的区域(122)上。本公开还涉及对应的用于这种工程机械(100)的方法和计算机程序。(The present disclosure relates generally to information systems (200) for a work machine (100), which are particularly suitable for projecting an image (206) onto an area (122) outside the work machine (100) based on construction data relating to the surroundings of the work machine (100), and to corresponding methods and computer programs for such a work machine (100).)
1, an information system (200) for a work machine (100), the information system (200) comprising:
-an illumination device (204), the illumination device (204) being arranged to project an image (206) onto an area (122) outside the work machine (100), and
a control unit (210), the control unit (210) being adapted to control the lighting arrangement,
characterized in that the control unit is adapted to:
-receiving construction data of parts of the surroundings of the work machine,
-forming the image to be projected based on the construction data,
-receiving information of a current position of the work machine, and
-projecting the image onto the area based on the current position of the work machine.
2. The information system (200) according to claim 1, wherein the lighting arrangement (204) is arranged to project the image (206) onto a ground (118) surrounding the work machine (100).
3. The information system (200) of claim 2, wherein the construction data includes information indicative of construction conditions below the surface (118).
4. The information system (200) of claim 2, wherein the construction data comprises information indicative of pipes and/or cables arranged below the surface (118).
5. The information system (200) of claim 1, wherein the control unit (210) is further adapted to receive geographical data related to the surroundings of the work machine (100).
6. The information system (200) of any of the preceding claims, wherein the control unit (210) is further adapted to receive sensor data related to the surroundings of the work machine (100).
7. The information system (200) of claim 6, wherein the sensor data is received from at least of a camera (216), a laser scanner, a radar device, and a lidar device.
8. The information system (200) of any of claims 5 to 7, wherein the control unit (210) is further adapted to adjust the formation of the image (206) based on the received data relating to the surroundings of the work machine (100).
9. The information system (200) of any of the preceding claims, wherein the control unit (210) is further adapted to adjust the formation of the image (206) based on a current position of an operator of the work machine (100).
10. The information system (200) of claim 8, wherein the control unit (210) is further adapted to receive information of a current location of the operator.
11. The information system (200) of any of the preceding claims, wherein the information of the current location of the work machine (100) is received from a geo-locating device (212) comprised by the work machine (100).
12. The information system (200) of any of the preceding claims, wherein the illumination device (204) comprises an image projector.
13. The information system (200) of any of the preceding claims, wherein the construction data is stored by a database (214) arranged in communication with the control unit (210).
method for assisting an operator of a work machine (100) using an information system (200), the information system (200) comprising a lighting device (204) and a control unit (210), the lighting device (204) being arranged to project an image (206) onto an area (122) outside the work machine (100), the control unit (210) being adapted to control the lighting device (204), wherein the method comprises the steps of:
-receiving (S1), at the control unit (210), construction data of a part of the surroundings of the work machine (100),
-forming (S2), by the control unit (210), the image (206) to be projected based on the construction data,
-receiving (S3), at the control unit (210), information of a current position of the work machine (100), and
-projecting (S4) the image onto the area (122) using the lighting arrangement based on the current position of the work machine (100).
15. The method of claim 14, further comprising the steps of:
-receiving at the control unit (210) geographical data of the surroundings of the work machine (100), and
-adjusting the forming of the image (206) based on the geographical data of the surroundings of the work machine (100).
16. The method of any of claims 14 and 15, further steps comprising:
-receiving information of the current position of the operator at the control unit (210), and
-adjusting the forming of the image (206) based on the current position of the operator of the work machine (100).
A work machine (100) of the kind 17, , comprising an information system (200) according to any of claims 1-13, .
18. The work machine (100) of claim 17, wherein the work machine (100) is at least of an excavator (100), a wheel loader, an articulated hauler, a bulldozer, a grader and a backhoe loader.
A computer program of , comprising program code means for performing the steps of any of claims 14-16 when said program is run on a computer.
Computer readable medium carrying a computer program comprising program components for performing the steps of any of claims 14-16 when said program components are run on a computer.
Technical Field
The present disclosure relates generally to information systems for a work machine, which information systems are particularly suitable for projecting images onto an area outside the work machine based on construction data (construction data) related to the surroundings of the work machine.
Background
Work machines such as, for example, excavators, dozers, loaders, etc. may be used to perform various tasks in construction, mining, and/or landscaping operations.A work machine of this type may typically be equipped with or more work implements (work tools) that may engage various objects to help perform tasks.
Recent advances in computer science now allow the above-described control systems to provide assistance to an operator to correlate, in real time, data acquired by sensors with the dynamic structural environment in which the work machine is operating. Based on this association, so-called Augmented Reality (AR) may be displayed to the operator to assist the operator in maneuvering the work machine.
In particular, AR may provide an operator with a view of a physical, real-world environment, the elements of which are enhanced (or supplemented) by computer-generated sensory input (e.g., sound, text, graphics, or video). In a typical prior art AR application, the data processor examines cues of the image captured by the camera that trigger the display of additional information and images along with the display of the captured image.
For example, AR information may be presented to an operator using a display screen disposed within an operator cab included with the work machine. However, such an embodiment entails that the operator needs to distribute his attention between the display and, for example, the work implement, thereby making the operation unstable and tiring.
Alternatively, more dynamic approaches may be employed, such as disclosed in US20140188333, in which the operator is provided with a Head Mounted Display (HMD) suitable for augmented reality capabilities, according to US20140188333, AR information may additionally be allowed to help the operator "see" the working implement even in the event that it is not visible from the operator's direct line of sight.
Although the solution proposed in US20140188333 provides a big improvement for safe operation of the work machine, the present inventors have identified the possibility of assisting the operator in the step without having to rely on forcing the operator to wear e.g. an HMD, allowing the step to reduce the risk further when operating the work machine e.g. at a construction site or the like.
Disclosure of Invention
According to aspects of the disclosure, the above problem is at least partly alleviated by a information system for a work machine, comprising a lighting device arranged to project an image onto an area outside the work machine, and a control unit adapted to control the lighting device, wherein the control unit is adapted to receive construction data of a portion of a surrounding of the work machine, to form an image to be projected based on the construction data, to receive information of a current position of the work machine, and to project the image onto the area based on the current position of the work machine.
Thus, according to the present disclosure, any projection of information for assisting an operator can be allowed at an area outside the work machine, i.e. without having to rely on presenting the information at a fixed or moving (e.g. HMD) display as proposed according to the prior art. Instead, the ground surrounding the work machine is used, for example, as "canvas" for presenting help information.
In addition, the presented information is based not only on where, for example, the implement comprised in the work machine is located, but also on external construction information related to the surroundings of the work machine used, and the current position of the work machine, to form information/images to be projected, for example, at said ground.
This embodiment has the advantage that the operator of the work machine may be allowed to "always" focus on "the right place" which is usually at the surroundings of the work machine, rather than in the operator cab comprised by the work machine, hi addition, the projected information will be easily available to more than persons/operators, without having to provide, for example, a dedicated HDM or the like to every operators/persons, in fact, the information may typically be projected where and when "needed", thus facilitating, for example, the interaction between the operator of the work machine and other persons working in the surroundings of the work machine, steps.
A "lighting device" should be understood to refer to a device or apparatus capable of providing visible illumination (including, for example, signs, icons, text, video, images, etc.) proximate a work machine.
In embodiments, the control unit may be an Electronic Control Unit (ECU) that is typically provided as an on-board component of a work machine, such as an excavator, wheel loader, articulated hauler, bulldozer, grader, and backhoe, or any form of corresponding construction equipment, in embodiments the work machine may include an internal combustion engine, or may be at least of a Pure Electric Vehicle (PEV) and a Hybrid Electric Vehicle (HEV). additionally, it should be understood that information regarding a current location of the work machine may be received from a geographic positioning device (such as a GLONASS or GPS receiver included with the work machine), for example.
In a non-limiting example of the present disclosure, the construction data may include information indicative of a construction condition below ground (e.g., indicative of pipes and/or cables disposed below ground). The control unit may thus, for example, receive construction data (possibly also map information) concerning how the surroundings of the work machine are currently arranged from a construction point of view. Thus, the illustrated tubes and/or cables can be "visualized" to the operator at their actual location, thereby assisting the operator when he/she is, for example, operating an implement of an excavator, to ensure that the implement does not make accidental contact with the tubes and/or cables.
In other words, the construction data may be indicative of portions or portions of a construction task to be performed by the work machine.
In a possible embodiment, the construction data is received from a database, for example arranged in communication with the control unit, in embodiments the database may be arranged on the work machine, however in another embodiments the database is arranged remotely from the control unit and may be accessed using a network connection such as the Internet, in embodiments the construction data may be provided as three dimensional location data relating to the construction or work site at which the work machine is operating.
In addition to the foregoing, the control unit may further be adapted to receive geographic data related to the surroundings of the work machine or more sensors disposed at or near the work machine can be used to acquire such geographic data such or more sensors may include, for example, at least of cameras, laser scanners, radar devices, IR-based devices, and lidar devices, hi addition to the construction data, such geographic data may relate to, for example, how the ground is disposed, to possible structures or obstacles in the surroundings of the work machine, and so on in embodiments, when forming an image to be projected at an area external to the work machine, the geographic data may be included.
Further, in embodiments of the present disclosure, it may be desirable to also estimate a current position of the operator relative to the work machine, e.g., using eye and/or head tracking mechanisms connected to the control unit, and adjust the formation of images to be projected based on the estimated position.
According to another aspect of the present disclosure, there is provided a method for assisting an operator of a work machine using an information system, the information system comprising a lighting device arranged to project an image onto an area outside the work machine and a control unit adapted to control the lighting device, wherein the method comprises the steps of receiving construction data of a portion of an ambient environment of the work machine at the control unit, forming an image to be projected by the control unit based on the construction data, receiving information of a current position of the work machine at the control unit, and projecting the image onto the area using the lighting device based on the current position of the work machine.
In addition, such embodiments of the present disclosure provide advantages similar to those discussed above with respect to the previous aspects of the present disclosure.
Advantages and advantageous features of step of the present disclosure are disclosed in the following description and in the dependent claims.
Drawings
The following is a more detailed description of embodiments of the disclosure, reference being made to the accompanying drawings by way of example.
In these figures:
FIG. 1 is a perspective view of a work machine in the form of an excavator provided with an information system according to the present disclosure;
figure 2 conceptually illustrates an information system, according to an example embodiment of the present disclosure;
fig. 3A and 3B are conceptual diagrams of images that may be formed projected onto an area outside the construction machine shown in fig. 1; and is
Fig. 4 illustrates process steps for performing a method according to the present disclosure.
Detailed Description
The present disclosure now will be described more fully hereinafter with reference to the accompanying drawings, in which presently preferred embodiments of the disclosure are shown. This disclosure may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided for completeness and to fully convey the scope of the disclosure to those skilled in the art. Like reference numerals refer to like elements throughout.
With particular reference to FIG. 1, a
As depicted, the
Turning now to FIG. 2, a possible embodiment of the
As discussed above, the
The
The memory may include volatile memory or non-volatile memory.
The
As indicated above, the
In addition to the above, the
It should further be appreciated that may allow for enhanced determination of the location of the
Referring to fig. 3A and 3B in conjunction with in fig. 4, two examples of using the
In fig. 3A, detailed instructions for digging a
The
Alternatively and as shown in FIG. 3B, this image may include information to be projected a step within the
Embodiments within the scope of the present disclosure include program products comprising machine-readable media for carrying or having machine-executable instructions or data structures stored thereon.
By way of example, such machine-readable media can comprise RAM, ROM, EPROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to carry or store desired program code in the form of machine-executable instructions or data structures and which can be accessed by a general purpose or special purpose computer or other machine with a processor.
Although the figures may show a specific order of method steps, the order of the steps may differ from that depicted. In addition, two or more steps may be performed simultaneously or partially simultaneously. Such variations will depend on the software and hardware systems chosen and on designer choice. All such variations are within the scope of the present disclosure. Likewise, software implementations could be accomplished with standard programming techniques with rule based logic and other logic to accomplish the various connection steps, processing steps, comparison steps and decision steps. In addition, while the present disclosure has been described with reference to specific exemplary embodiments thereof, many different modifications, variations, and the like will become apparent to those skilled in the art.
In addition, in the claims, the word "comprising" does not exclude other elements or steps, and the indefinite articles "" or "" does not exclude a plurality.
- 上一篇:一种医用注射器针头装配设备
- 下一篇:具体地用于制造水平建筑结构的平直的建筑元件