Engineering machine with image projection equipment
阅读说明:本技术 设有图像投影设备的工程机械 (Engineering machine with image projection equipment ) 是由 雷诺·费拉 伦纳特·斯科格 于 2017-06-13 设计创作,主要内容包括:本公开总体上涉及一种工程机械(100),其中,工程机械(100)设有图像投影设备(200),该图像投影设备特别适于将图像投影在工程机械(100)所包括的外部部件的表面处。本公开还涉及对应的、用于这种工程机械(100)的方法和计算机程序。(The present disclosure generally relates to a work machine (100), wherein the work machine (100) is provided with an image projection device (200) which is particularly adapted for projecting an image at a surface of an external component comprised by the work machine (100). The disclosure also relates to a corresponding method and computer program for such a working machine (100).)
1. A work machine (100) comprising:
-a work machine structure (108),
-a work machine means (104, 106), which work machine means (104, 106) is pivotally connected to the work machine structure (108), and
-an operator cab (112), the operator cab (112) being provided at the work machine structure (108) and being provided with control means adapted to allow an operator to control the position of the work machine means (104, 106),
characterized in that the engineering machine (100) further comprises:
-an image projection device (200), the image projection device (200) being configured to project an image (302, 304, 306, 312, 314) at a surface (122) of the work machine component (104, 106) facing the operator's cab (122), wherein the projected image (302, 304, 306, 312, 314) comprises information for the operator to control the work machine (100).
2. A working machine (100) according to claim 1, wherein the image projection device (200) comprises a laser projector (204).
3. A working machine (100) according to any of claims 1 and 2, wherein the image projecting device (200) further comprises a control unit (210), the control unit (210) being adapted to adjust the position of the image projected at the surface of the working machine (104, 106) based on an expected position of the operator when the operator is located at the operator cab (122) and a current position of the working machine (104, 106).
4. A working machine (100) according to claim 3, wherein the control unit (210) is adapted to receive information indicative of a current position of the working machine implement (104, 106).
5. A working machine (100) according to any of claims 3 and 4, wherein the control unit (210) is further adapted to receive information indicative of a head position of the operator and to control the position of the image (302, 304, 306, 312, 314) projected at the surface (122) of the working machine means (104, 106) based on the head position.
6. A working machine (100) according to any of the preceding claims, wherein the working machine means (104, 106) comprises at least one of an implement (106) and a coupling (104).
7. A working machine (100) according to any of claims 1-5, wherein the working machine means (104, 106) comprises a bucket.
8. A working machine (100) according to any of the preceding claims, wherein the working machine (100) is at least one of an excavator (100), a wheel loader, a bulldozer, a grader and a backhoe loader.
9. A work machine (100) according to any of the preceding claims, wherein the projected image (302, 304, 306, 312, 314) comprises information for the operator to control the work machine means (104, 106).
10. A work machine (100) according to any of the preceding claims, wherein the projected image (302, 304, 306, 312, 314) comprises information for positioning the work machine means (104, 106).
11. A working machine (100) according to any of the preceding claims, wherein the projected image (302, 304, 306, 312, 314) comprises information for informing the operator about parameters related to the operation of the working machine (100).
12. A working machine (100) according to claim 7, wherein the projected image (302, 304, 306, 312, 314) comprises information about at least one of: a desired fill level and a maximum fill level of the bucket.
13. A work machine (100) according to any of the preceding claims, wherein the projected image (302, 304, 306, 312, 314) is adapted based on a repositioning of the work machine device (104, 106) by the operator.
14. A working machine (100) according to any of the preceding claims, wherein the projected image (302, 304, 306, 312, 314) comprises at least one of lines and symbols.
15. A method for assisting an operator of a work machine, wherein the work machine (100) comprises:
-a work machine structure (108),
-a work machine means (104, 106), the work machine means (104, 106) being pivotally connected to the work machine structure (108),
-an operator cab (112), the operator cab (112) being provided at the work machine structure (108) and being provided with control means adapted to allow the operator to control the position of the work machine means (104, 106),
-an image projection device (200), the image projection device (200) being for projecting an image (302, 304, 306, 312, 314), and
a control unit (210), the control unit (210) being configured to control the image projection device (200),
wherein the method comprises the steps of:
-determining the position of the work machine means (104, 106) using the control unit (210), and
-projecting the image (302, 304, 306, 312, 314) at a surface (122) of the work machine device (104, 106) facing the operator cab (112), based on the determined position of the work machine device (104, 106).
16. The method of claim 15, further comprising the steps of:
-determining the head position of the operator, an
-adjusting a position of the image (302, 304, 306, 312, 314) projected at the surface (122) of the work machine device (104, 106) based on the head position of the operator.
17. The method according to any one of claims 15 and 16, further comprising the step of:
-adjusting information comprised by the projected image (302, 304, 306, 312, 314) for instructing the operator to reposition the work machine component (104, 106).
18. The method according to any one of claims 15 to 17, further comprising the step of:
-adjusting information comprised by the projected image (302, 304, 306, 312, 314) based on the operator repositioning the work machine device (104, 106).
19. The method of any of claims 15 to 18, wherein the image (302, 304, 306, 312, 314) is selected to include at least one of a line and a symbol.
20. The method of claim 15, wherein the work machine implement (104, 106) comprises a bucket, and the method further comprises the steps of:
-selecting the projected image (302, 304, 306, 312, 314) to comprise information relating to at least one of a desired fill level and a maximum fill level of the bucket.
21. A computer program comprising program code means for performing the steps of any one of claims 15 to 20 when said program is run on a computer.
22. A computer readable medium carrying a computer program, the computer program comprising program code means for performing the steps of any of claims 15 to 20 when the program is run on a computer.
Technical Field
The present disclosure generally relates to a working machine, wherein the working machine is provided with an image projection device which is particularly adapted to project an image at a surface of an external component comprised by the working machine. The disclosure also relates to a corresponding method and computer program for such a working machine.
Background
Work machines in the form of, for example, excavators, dozers, loaders, etc., may be used to perform a variety of tasks during construction, mining, and/or landscaping operations. Such work machines may typically be equipped with one or more work implements (work implements) capable of engaging various objects to assist in performing tasks. The work implement may be adjusted or manipulated in a desired manner by an operator, which may be located on the work machine, for example. There are various control systems and techniques to be incorporated into such work machines for assisting operators thereof in controlling the work machine and/or work implement. These systems and techniques can interact with a wide variety of sensors for providing information and data to an operator about the work machine and/or work implement to further assist in controlling the work machine and/or work implement.
Recent advances in computer science now allow the above-described control systems to provide assistance to an operator to correlate, in real time, data acquired by sensors with the dynamic structural environment in which the work machine is operating. Based on this association, a so-called Augmented Reality (AR) may be displayed to the operator for assisting the operator in maneuvering the work machine.
In particular, the AR may provide the operator with a view of the physical real-world environment, the elements of which are enhanced (or supplemented) by computer-generated sensory input (e.g., sound, text, graphics, or video). In a typical prior art AR application, the data processor examines the image captured by the camera for clues that trigger the display of additional information and images along with the display of the captured image.
For example, AR information may be presented to an operator using a display screen disposed within an operator cab included with the work machine. However, such an embodiment entails that the operator needs to distribute his attention between the display and, for example, the work implement, thereby making the operation unstable and tiring.
Alternatively, a more dynamic approach may be employed, such as disclosed in US20140188333, in which the operator is provided with a Head Mounted Display (HMD) suitable for augmented reality capabilities. According to US20140188333, AR information may additionally be allowed to help an operator "see" a work implement even in cases where the work implement is not visible from the operator's direct line of sight.
Although the solution proposed in US20140188333 provides a big improvement for safe operation of the work machine, the present inventors have identified further possibilities to assist the operator without having to rely on forcing the operator to wear e.g. an HMD, allowing further reduction of risks when operating the work machine e.g. at a construction site or the like.
Disclosure of Invention
According to an aspect of the disclosure, the above problem is at least partly alleviated by a work machine comprising: an engineering mechanical structure; a work machine device pivotably connected to the work machine structure; and an operator cab arranged at the work machine structure and provided with control means adapted to allow an operator to control the position of the work machine means, wherein the work machine further comprises an image projection device for projecting an image at a surface of the work machine means facing the operator cab, and the projected image comprises information for the operator to control the work machine.
Thus, according to the present disclosure, any projection of information for assisting an operator can be allowed at an area outside the work machine, i.e. without having to rely on presenting information at a fixed or moving (e.g. HMD) display as proposed according to the prior art. Instead, the work machine implement included with the work machine is used as a "canvas" to present help information.
This embodiment brings the advantage that it may allow the operator of the work machine to focus on the "right place" which will usually be outside the operator's cab rather than inside the operator's cab. In addition, the projected information can generally be projected at "desired" locations and times without providing, for example, a dedicated HDM or the like to the operator. In addition, the solution proposed by the present disclosure solves the depth of focus problem of the prior art, which is: when the operator switches his line of sight between the work machine implement and a display device arranged in the operator's cab, the operator must refocus.
An image projection device is understood to mean a device or apparatus capable of providing visible illumination (including, for example, marks, lines, symbols, icons, text, images, etc.) at a surface of a work machine implement facing an operator's cab. The image projection device may thus comprise different types of light sources, such as Light Emitting Diodes (LEDs) or LED arrays, etc. Other alternatives are of course conceivable, such as lasers, image/video projectors, etc. In some embodiments, the use of a laser projector may be preferred because the laser projector can provide a highly focused monochromatic beam of light to project an image at the surface of the work machine implement than can be achieved in some implementations using a less focused beam of light from, for example, an image projector. However, it should be understood that in some embodiments of the present disclosure, it may be appropriate to use an image projector.
Furthermore, the work machine may be, for example, at least one of an excavator, a wheel loader, a bulldozer, a grader and a backhoe loader, or any form of corresponding construction equipment comprising suitable work machine components which are arranged externally and at the same time visible to the operator and which are adapted to allow projection of images in the manner described above. Accordingly, the work machine component may of course depend on the type of work machine. For example, in some embodiments, the work machine device may include at least one of an implement and a coupling. The implement may be, for example, a bucket or the like.
In some embodiments, the work machine may include an internal combustion engine, or may be at least one of a Pure Electric Vehicle (PEV) and a Hybrid Electric Vehicle (HEV). Further, in some embodiments of the present disclosure, it may be desirable to equip the work machine with a geo-locating device, such as a GLONASS or GPS receiver included with the work machine, for determining a current position of the work machine, such as at a work or construction site. The information related to the position of the work machine may also include information related to the relative orientation of the work machine.
In an embodiment of the disclosure, the image projecting device further comprises a control unit adapted to adjust the position of the image projected at the surface of the work machine implement based on an expected position of the user when the user is located at the operator cab. Such estimation may be performed, for example, using eye and/or head tracking mechanisms connected to the control unit. In the case where the estimated position is available, it is possible to allow, for example, a perspective view of an image to be correctly projected when viewed from the current position of the operator. The estimation may be performed by: determining a substantially accurate position of the operator or the operator's head/eyes; or alternatively, for example, the operator is estimated to be located in a seat arranged in an operator cab comprised by the work machine.
In one embodiment, the control unit may be an Electronic Control Unit (ECU) which is typically provided as an onboard component of the work machine. Furthermore, the control unit is preferably adapted to receive information indicative of a current position of the work machine implement (e.g. relative to an operator cab or the ground) and to adapt the image projected at the work machine implement based on the current position of the work machine implement and/or the position of the operator.
The image projected at the surface of the work machine implement may include information of a current or future task to be performed by an operator of the work machine, e.g., how to control the work machine implement at, for example, a current location of the work machine. Such information may include, for example, a particular task using the implement of the excavator, such as digging a pit in the ground at a particular location. Thus, the formed and projected image may include information for the operator where mining is to be performed ("mining instructions"). The excavation instructions or similar instructions may also include warnings to the operator regarding, for example, pipes and/or conduits disposed in the ground. Thus, with such information on hand, possible excavation accidents can be reduced. This information may also be used to inform the operator of, for example, at least one of: a desired fill level and a maximum fill level of the bucket.
However, it should be understood that the information provided to the operator may additionally or alternatively include, for example, driving instructions for the operator to maneuver the work machine. Alternatively, the information may be adapted to provide feedback to the operator regarding the operation of the work machine, for example to operate the work machine in a more fuel efficient manner or the like.
In addition to the above, the control unit may further be adapted to receive geographical data related to the surroundings of the work machine. Such geographical data may be acquired using one or more sensors disposed at or near the work machine. Such one or more sensors may, for example, include at least one of a camera, a laser scanner, a radar device, an IR-based device, and a lidar device. The geographical data may provide information about, for example, how the ground is arranged, possible structures or obstacles in the surroundings of the work machine, etc. In one embodiment, the geographic data may be included when forming an image to be projected at a surface of the work machine device.
According to another aspect of the present disclosure, a method for assisting an operator of a work machine is provided, wherein the work machine comprises: an engineering mechanical structure; a work machine device pivotably connected to the work machine structure; an operator cab arranged at the work machine structure and provided with control means adapted to allow an operator to control the position of the work machine means; an image projection device for projecting an image; and a control unit for controlling the image projection apparatus, wherein the method comprises the steps of: determining a position of the work machine device using the control unit; and projecting the image at a surface of the work machine device facing the operator cab based on the determined position of the work machine device. This aspect of the disclosure provides advantages similar to those discussed above with respect to the previous aspects of the disclosure.
It should be understood that the concept according to the present disclosure may be implemented as a computer program adapted to be executed, for example, using a control unit comprised by a work machine as discussed above. Additionally, such embodiments of the present disclosure provide advantages similar to those discussed above with respect to the previous aspects of the present disclosure. The computer program may for example be stored on a computer readable medium, wherein the computer readable medium may be any type of storage device, including one of the following: removable nonvolatile random access memory, hard drives, floppy disks, CD-ROMs, DVD-ROMs, USB memory, SD memory cards, or similar computer-readable media known in the art.
Further advantages and advantageous features of the disclosure are disclosed in the following description and in the dependent claims.
Drawings
With reference to the accompanying drawings, the following is a more detailed description of embodiments of the disclosure cited as examples.
In these figures:
FIG. 1 is a perspective view of a work machine in the form of an excavator provided with an image projection arrangement according to the present disclosure;
FIG. 2 conceptually illustrates an image projection device, according to an example embodiment of the present disclosure;
3A-3D are conceptual illustrations of images that may be formed projected onto a surface of a work machine implement facing an operator's cab; and is
Fig. 4 illustrates process steps for performing a method according to the present disclosure.
Detailed Description
The present disclosure now will be described more fully hereinafter with reference to the accompanying drawings, in which presently preferred embodiments of the disclosure are shown. This disclosure may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided for thoroughness and completeness, and fully convey the scope of the disclosure to those skilled in the art. Like reference numerals refer to like elements throughout.
With particular reference to FIG. 1, a
The
As depicted, the
The
Turning now to FIG. 2, a possible embodiment of an image-projecting
The image-projecting
The processor may be or include any number of hardware components for performing data or signal processing or for executing computer code stored in memory. The memory may be one or more devices for storing data and/or computer code to perform or facilitate the various methods described in this specification. The memory may include volatile memory or non-volatile memory. The memory may include database components, object code components, script components, or any other type of information structure for supporting the various activities of the specification. According to exemplary embodiments, the systems and methods of the present description may utilize any distributed or local storage. According to an exemplary embodiment, the memory is communicatively connected to the processor (e.g., via circuitry or any other wired, wireless, or network connection) and includes computer code for performing one or more of the processes described herein.
The
The image-projecting
In addition to the above, the
In addition, the
With further reference to fig. 3A-3D in conjunction with fig. 4, four examples of using the image-projecting
In fig. 3A, the operator is provided with basic instructions at the
Instructions to be provided to the operator according to fig. 3A are provided for controlling the position of the implement 106 relative to the
As a result of the projected
Alternatively, and as shown in fig. 3B, a
In fig. 3C, yet another example of providing instructions to an operator for operating the implement 106 is provided. Specifically, in fig. 3C, it is desirable to keep the appliance "leveled". A determination is made as to the current location/position of the implement 106 and indicates that the implement has been slightly rotated. As a result, a rotated
Furthermore, and as described above, the image projected at the
As mentioned above, the image projected at
The present disclosure contemplates methods, apparatus, and program products on any machine-readable media for accomplishing various operations. Embodiments of the present disclosure may be implemented using existing computer processors or by special purpose computer processors for appropriate systems incorporated for this or other purposes or by hardwired systems. Embodiments within the scope of the present disclosure include program products comprising machine-readable media for carrying or having machine-executable instructions or data structures stored thereon. Such machine-readable media can be any available media that can be accessed by a general purpose or special purpose computer or other machine with a processor.
By way of example, such machine-readable media can comprise RAM, ROM, EPROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to carry or store desired program code in the form of machine-executable instructions or data structures and which can be accessed by a general purpose or special purpose computer or other machine with a processor. When information is transferred or provided over a network or another communications connection (either hardwired, wireless, or a combination of hardwired or wireless) to a machine, the machine properly views the connection as a machine-readable medium. Thus, any such connection is properly termed a machine-readable medium. Combinations of the above are also included within the scope of machine-readable media. Machine-executable instructions comprise, for example, instructions and data which cause a general purpose computer, special purpose computer, or special purpose processing machines to perform a certain function or group of functions.
Although the figures may show a specific order of method steps, the order of the steps may differ from that depicted. In addition, two or more steps may be performed simultaneously or partially simultaneously. Such variations will depend on the software and hardware systems chosen and on designer choice. All such variations are within the scope of the present disclosure. Likewise, software implementations could be accomplished with standard programming techniques with rule based logic and other logic to accomplish the various connection steps, processing steps, comparison steps and decision steps. In addition, while the present disclosure has been described with reference to specific exemplary embodiments thereof, many different modifications, variations, and the like will become apparent to those skilled in the art.
Variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed disclosure, from a study of the drawings, the disclosure, and the appended claims. Furthermore, in the claims, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality.
- 上一篇:一种医用注射器针头装配设备
- 下一篇:添加剂分配器