阅读说明：本技术 与附近的其它行动装置协同闪光的行动装置及其方法 (mobile device and method for flashing light in cooperation with other nearby mobile devices ) 是由 梁原滔 于 2018-09-26 设计创作，主要内容包括：一种用于与附近的其它行动装置协同闪光的方法。所述用于与其它行动装置协同闪光的方法应用于行动装置中,该方法包含:行动装置预先拍摄拍摄主体的照片,并分析该预先拍摄的照片以取得照明条件。如果该照明条件不是最佳的,该行动装置会计算额外的闪光灯位置,并识别靠近该闪光灯位置的附近的其它行动装置。行动装置的用户可以经由用户接口选择一个或多个附近的其它行动装置,并且该行动装置可以请求其它行动装置移动到该闪光灯位置,并在该行动装置拍照时同步闪光。该行动装置还可以于其它行动装置彼此分享不同角度的照片。本发明还提供一种用于与附近的其它行动装置协同闪光的行动装置。本发明可以可以联合其它行动装置,将其它行动装置的闪光作为离机闪光,协同完成拍照。(A method for flashing light in conjunction with other nearby mobile devices. The method for flashing in coordination with other mobile devices is applied to the mobile devices and comprises the steps that the mobile devices take pictures of subjects in advance, and the pictures taken in advance are analyzed to obtain lighting conditions. If the lighting conditions are not optimal, the mobile device calculates additional flash locations and identifies other mobile devices in the vicinity that are near the flash location. The user of the mobile device may select one or more other mobile devices in the vicinity via the user interface, and the mobile device may request that the other mobile devices move to the flash position and synchronize the flash while the mobile device takes a picture. The mobile device can also share photos from different angles with other mobile devices. The invention also provides a mobile device for flashing in cooperation with other mobile devices in the vicinity. The invention can be combined with other action devices, and the flash of other action devices is taken as off-line flash to finish the photographing in a coordinated manner.)

1. a first mobile device for flashing in conjunction with one or more second mobile devices, the first mobile device comprising:

A processor; and

A computer readable storage medium storing at least one computer program, wherein the computer program contains instructions executed by the processor to cause the processor to perform the steps of:

Receiving location messages from the one or more second mobile devices;

establishing a map, wherein the map comprises position information of the first mobile device and the one or more second mobile devices, and distances from the one or more second mobile devices to a subject;

Pre-taking a picture of the photographic subject; and

Analyzing the photo and judging whether light supplement is needed or not; wherein, if the light supplement is needed, the processor further executes the following steps:

Indicating one or more suggested locations of the flash and the one or more second mobile devices proximate to the suggested locations on a user interface;

Receiving a user selection from the user interface, the selection including some or all of the one or more second mobile devices;

Synchronizing the photographing time with each selected second mobile device; and

And taking a picture of the shooting subject, so that the selected second action devices cooperatively flash.

2. The first mobile device of claim 1, wherein the determining whether light is needed further comprises determining whether the photographic subject is in a low light condition, and if the photographic subject is in the low light condition, marking a right back and an oblique back of the photographic subject as suggested locations for flashing lights on the user interface.

3. The first mobile device of claim 2, wherein if the photographic subject is not in a low-light environment, the step of determining whether light is to be supplemented further comprises determining whether there is a hue deviation in the photograph, and if there is a hue deviation in the photograph, marking the right back and the oblique back of the photographic subject as suggested locations for flashing lights on the user interface.

4. The first mobile device of claim 3, wherein if there is no hue deviation in the photograph, the determining whether light is to be supplemented further comprises determining whether the photographic subject is in a backlit environment, and if the photographic subject is in a backlit environment, marking the left and right sides of the photographic subject as suggested locations for flashing lights on the user interface.

5. The first mobile device of claim 4, wherein if the photographic subject is not in a backlit environment, the step of determining whether light is to be supplemented further comprises determining whether the photo has more light than contrast, and if the photo has more light than contrast, marking a dark place of the scene where the photographic subject is located as a suggested position of a flash on the user interface.

6. A first traveller according to claim 1, characterised in that the one or more proposed positions are calculated from a light source direction and a light source position.

7. A method for implementing coordinated flashing of one or more second mobile devices, performed in a first mobile device, the method comprising:

receiving location messages from the one or more second mobile devices;

Establishing a map, wherein the map comprises position information of the first mobile device and the one or more second mobile devices, and distances from the one or more second mobile devices to a shooting subject;

Pre-taking a picture of the photographic subject; and

Analyzing the photo and judging whether light supplement is needed or not; wherein, if the light supplement is needed, the method further comprises the following steps:

Indicating one or more suggested locations for the flash and the one or more second mobile devices proximate to the suggested locations on a user interface;

Receiving a user selection from the user interface, the selection including some or all of the one or more second mobile devices;

Synchronizing the photographing time with each selected second mobile device; and taking a picture of the shooting subject, so that the selected second action devices cooperatively flash.

8. The method of claim 7, wherein the determining whether light is needed further comprises determining whether the photographic subject is in a low light condition, and if the photographic subject is in the low light condition, marking a right back and an oblique back of the photographic subject as suggested locations for flashing lights on the user interface.

9. The method of claim 8, wherein if the photographic subject is not in a low light environment, the step of determining whether light is needed further comprises determining whether there is a hue deviation in the photograph, and if there is a hue deviation in the photograph, marking the right back and the oblique back of the photographic subject as suggested locations for flashing lights on the user interface.

10. the method of claim 9, wherein if there is no hue deviation in the photograph, the determining whether supplemental lighting is required further comprises determining whether the photographic subject is in a backlit environment, and if the photographic subject is in a backlit environment, marking left and right sides of the photographic subject as suggested locations for flashing lights on the user interface.

11. The method of claim 10, wherein if the subject is not in a backlit environment, the step of determining whether light is needed further comprises determining whether the photo has more light than contrast, and if the photo has more light than contrast, marking a dark place of the scene where the subject is located as a suggested position of the flash on the user interface.

12. The method of claim 7, wherein the one or more suggested positions are calculated from a light source direction and a light source position.

Technical Field

The present invention relates to the field of communications, and more particularly, to functionality of a mobile device.

background

With the popularization and convenience of mobile devices, it is becoming popular to use cameras of mobile devices to take pictures. The enhancement of the photographing function of the mobile device mainly depends on the large-size photosensitive assembly and the large aperture in the aspects of pixels, aperture, focusing speed, hand shock resistance and the like, but it is difficult to take a picture with sufficient ideal brightness in the end.

At present, flash lamps with double color temperatures are available on the market, and mainly comprise white light LEDs and warm color temperature LEDs, wherein the LEDs can twinkle during shooting to imitate natural light. However, common problems with using a single flash include excessive gloss when capturing a portrait, lack of stereoscopic perception, and insignificant effectiveness when capturing a distance. Although a xenon lamp is introduced as a light supplement device by a mobile device manufacturer, a user needs to purchase additional equipment, and the device needs to be installed on a mobile device, so that light supplement cannot be performed from different directions.

Disclosure of Invention

accordingly, it is desirable to provide a mobile device and a method thereof that cooperate with other nearby mobile devices to flash light, so that the flash light of other mobile devices can be used as an off-line flash light to cooperate with other mobile devices to complete a photo.

The present invention provides a first mobile device for flashing in conjunction with one or more second mobile devices, the first mobile device comprising: a processor; and a computer readable storage medium storing at least one computer program, wherein the computer program comprises instructions for execution by the processor to cause the processor to receive location information from the one or more second mobile devices; establishing a map, wherein the map comprises position information of the first mobile device and the one or more second mobile devices, and distances from the one or more second mobile devices to a shooting subject; pre-taking a picture of the photographic subject; analyzing the photo and judging whether light is required to be supplemented or not; if the light supplement is needed, the processor further executes the following steps of marking one or more flash suggestion positions and one or more second mobile devices close to the suggestion positions on the user interface; receiving a user selection from the user interface, the selection including some or all of the one or more second mobile devices; synchronizing the photographing time with each selected second mobile device; and taking a picture of the shooting subject, so that the selected second action devices cooperatively flash.

the invention also provides a method for realizing one or more second mobile devices to cooperatively flash, which is executed in a first mobile device, and comprises the following steps: receiving location messages from the one or more second mobile devices; establishing a map, wherein the map comprises position information of the first mobile device and the one or more second mobile devices, and distances from the one or more second mobile devices to a shooting subject; pre-taking a picture of the photographic subject; analyzing the photo and judging whether light is required to be supplemented or not; marking one or more flash suggested positions and one or more second mobile devices close to the suggested positions on a user interface; receiving a user selection from the user interface, the selection including some or all of the one or more second mobile devices; synchronizing the photographing time with each selected second mobile device; and taking a picture of the shooting subject, so that the selected second action devices cooperatively flash.

Compared with the prior art, the mobile device and the method thereof which utilize the flash in coordination with other nearby mobile devices avoid the burden of purchasing one or more off-line flash devices. In a shooting scene, a plurality of mobile devices can shoot photos with ideal lighting conditions in cooperation with flash, and the photos shot at different angles can be shared with each other.

drawings

FIG. 1 is a block diagram of an embodiment of a mobile device.

FIG. 2 is a schematic diagram of an embodiment of a collaborative flash application environment.

FIG. 3 is a diagram of an embodiment of a user interface of a photographing application.

FIG. 4 is a diagram of another embodiment of a user interface of a photographing application.

FIG. 5 is a diagram of another embodiment of a user interface of a photographing application.

FIG. 6 is a diagram of another embodiment of a user interface of a photographing application.

FIG. 7 is a flowchart of an embodiment of a mobile device initiating a coordinated flash.

fig. 8 is a flowchart of an embodiment of providing a fill light suggestion.

FIG. 9 is a flow diagram of selected other mobile devices collaborating with a flash in a scene, in one embodiment.

Description of the main elements

Mobile device	100,100A-100D
		Processor with a memory having a plurality of memory cells	110
Computer readable storage medium	120
		Camera module	130
Flash module	140
		GPS module	150
Application environment	200
		Shooting subject	210
User interface	300,400,500,600
		Flow path	700,800,900

Detailed Description

Fig. 1 is a block diagram of a mobile device 100 according to an embodiment of the invention. The mobile device 110 may be, for example, a smart device, a mobile phone, a tablet computer, etc., and is a calculator device that is convenient for a user to carry. The mobile device 100 may include a processor 110 and a computer-readable storage medium 120. The processor 110 is a central processing unit of the mobile device 100 and includes one or more integrated circuits, such as a single-core, multi-core microprocessor or microcontroller, for communicating with a plurality of modules of the mobile device 100 and controlling functions of the mobile device 100. The computer-readable storage medium 120 may be any form of computer-readable storage medium, such as flash memory, or any other non-volatile storage medium. The computer-readable storage medium 120 may store one or more computer programs for implementing the functions of the mobile device 100 and be executed by the processor 110.

In one embodiment, the modules communicating with the processor 110 include a camera module 130, a flash module 140, a Global Positioning System (GPS) module 150, and a wireless communication module 160. The camera module 130 is used for capturing still images or video; the flash module 140 is used for generating flash light to illuminate the image scene captured by the camera module 130. In one embodiment, the camera module 130 includes a lens, a Charge-coupled Device (CCD), an auto-focusing mechanism, and a basic image processing mechanism. In one embodiment, the flash module 140 may include a xenon Light Emitting device and a Light Emitting Diode (LED). The GPS module 150 can identify longitude, latitude, or other geographic location information of the mobile device 100 and provide this information to various computer programs for use. The wireless communication module 160 may include Wi-Fi, Bluetooth, and other wireless communication technology interfaces. The wireless communication module 160 can be used for the mobile device 100 to perform with other mobile devices, exchange data and geographic location information, etc.

Fig. 2 is a schematic diagram of an application environment 200 in which the mobile device 100 cooperates with other mobile devices 100A, 100B, 100C, and 100D to capture a still image. In one embodiment, each of the mobile devices 100 and 100A-100D may download and install a camera application to use the flash components of the other mobile devices as an off-line flash for taking still images. The mobile device 100 can perform two-way communication with other mobile devices 100A-100D using the camera application via the wireless communication module 160. When the photography application determines that the lighting conditions are not optimal for the photographic subject 210, the mobile device 100 may request that the mobile devices 100A-100D support the off-the-air flash function. The poor lighting conditions include low light environment, backlight shooting, uneven ambient brightness, and color variation of ambient light. When the mobile devices 100A-100D agree to support, some or all of the mobile devices receive a location indication (e.g., the dashed arrows shown in FIG. 2 for the mobile devices 100A and 100B). When all the mobile devices are located at the ideal position, the mobile device 100 takes a picture and the mobile devices 100A-100D synchronously generate flash lights.

In one embodiment, the user can execute the photographing application program on the mobile device 100 and properly focus on the photographing main body 210. The camera application can obtain the geographic location information of the mobile device 100 through the GPS module 150 and receive the geographic location information of the mobile devices 100A-100D through the wireless communication module 160. In one embodiment, the camera application may create a map that includes the location of the mobile device 100A-100D, the indicated movement direction, and the distance to the photographic subject 210.

In one embodiment, the camera application can be used to determine whether to use the off-line flash function for light supplement. For example, in a low light environment, where ambient light provides only background exposure, a flash will be the primary light source for the subject 210 described above. The photography application may indicate the suggested location of the off-the-air flash and other action devices near the suggested location. Fig. 3 is a diagram illustrating an embodiment of a user interface 300 for executing the camera application on the mobile device 100. The user interface 300 described above may display map details. In the present embodiment, the icon 310 represents the above-described action device 100, the icon 320 represents the above-described photographic subject 210, the selectable icons 330 and 340 represent suggested positions of the off-air flash, and the selectable icons 350 and 360 represent other action devices in the vicinity of the suggested positions. The aforementioned optional illustrations 350 and 360 are further indicated by dashed circles to distinguish them from other icons (e.g., icons 370, 380, and 390). The proposed position may be calculated from the light source direction and position. In one embodiment, the camera application may suggest placing an off-camera flash directly behind the photographic subject 210 (e.g., at the optional graphic representation 330) to highlight the photographic subject 210. The camera application may also suggest placing another off-camera flash diagonally behind the photographic subject 210 (e.g., at the optional illustration 340) to increase the perspective of the photographic subject 210.

In another embodiment, when there is an ambient light source behind the main shooting object 210, so that the brightness difference between the main shooting object 210 and the background is too large, the shooting application determines that there is a backlight shooting situation at this time, and light needs to be supplemented, so that the brightness of the main shooting object 210 and the ambient brightness can be consistent. In this embodiment, the off-board flash will be the secondary light source in addition to the ambient light source to properly expose the subject 210 as described above. Fig. 4 is a schematic diagram of a user interface 400 for executing the photographing application program in the mobile device 100 according to the embodiment. The user interface 400 described above may display map details. In the present embodiment, the diagram 405 represents a main light source for the above-described photographic subject 210, for example, sunlight, the diagram 410 represents the above-described action device 100, the icon 420 represents the above-described photographic subject 210, the selectable diagrams 430 and 440 represent suggested positions of off-plane flashing light, and the selectable icons 450 and 460 represent other action devices in the vicinity of the suggested positions. The optional representations 450 and 460 are further marked with dashed circles to distinguish them from other icons (e.g., icons 470 and 480). In one embodiment, the camera application may suggest placing an off-camera flash on a side of the photographic subject 210 (e.g., at the optional illustration 430) to fill in the shadow area of the photographic subject 210. The camera application may also suggest placing another off-camera flash on the other side of the photographic subject 210 (e.g., at the optional illustration 440) so that the brightness of the photographic subject 210 is uniform.

In another embodiment, the camera application determines that light is needed when there is uneven ambient brightness. In the present embodiment, the above-described photographic scene of the photographic subject 210 has both light-emitting and non-light-emitting objects, so that the light contrast is large. Fig. 5 is a schematic diagram of a user interface 500 for executing the photographing application program in the mobile device 100 according to the embodiment. The user interface 500 described above may display map details. In the present embodiment, the icon 502 and the icon 504 represent different light sources causing a large contrast of light in a shooting scene of the above-described photographic subject 210, the icon 510 represents the above-described action device 100, the icon 520 represents the above-described photographic subject 210, the optional icon 530 represents an advised position of an off-hook flash, and the optional icon 540 represents other action devices in the vicinity of the advised position. The optional illustration 540 is further marked with a dashed circle to distinguish it from other icons (e.g., icons 550, 560, and 570). In one embodiment, the camera application may suggest placing an off-line flash in the shadow of the scene in which the photographic subject 210 is located (e.g., at the optional illustration 530) to highlight details of the photographic subject 210 from the shadow fill.

In another embodiment, when the ambient light source has a color deviation, for example, under the light of a mercury lamp in a gym, a picture is taken with a green color, and the photographing application determines that light needs to be supplemented. In this embodiment, most of the color is lost even with white balance, requiring ambient light to be excluded and flash light to be the primary light source. Fig. 6 is a schematic diagram of a user interface 600 for executing the photographing application program in the mobile device 100 according to the embodiment. The user interface 600 described above may display map details. In the present embodiment, the icon 610 represents the above-described action device 100, the icon 620 represents the above-described photographic subject 210, the selectable icons 630 and 640 represent suggested positions of the off-air flash, and the selectable icons 650 and 660 represent other action devices in the vicinity of the suggested positions. The optional representations 650 and 660 are further marked with dashed circles to distinguish them from other icons (e.g., icons 670, 680, and 690). In one embodiment, the photography application may suggest the use of more than one off-the-air flash to correct for hue deviations (e.g., the optional illustrations 630 and 640 described above).

In one embodiment, the user of the mobile device 100 may select one or more mobile devices and suggested locations for off-hook flashes on the user interface of the camera application. For example, referring to fig. 3, the user can select the selectable icons 350 and 330 on the user interface 300. In one embodiment, after the user selects one or more mobile devices, a photographing interface may be displayed on the user interface 300, so that the user can take still images. In one embodiment, when the user touches the photo icon on the photo interface, the mobile device 100 may send a cooperative flash request to the selected mobile device via the wireless communication module 160, requesting or inviting the user of the selected mobile device to manually turn the mobile device, so that the camera and the flash of the mobile device can face the main body 210 and move to the indicated position. Once the user of the selected mobile device has received the request and moved to the indicated location, the mobile device 100 receives a reply from the selected mobile device. After receiving the reply from the selected mobile device, the mobile device 100 may use WI-FI authenticated TimeSyncTM technology for providing accurate time synchronization between the mobile device 100 and the selected mobile device, so that the selected mobile device may cooperatively flash when the mobile device 100 takes a picture.

fig. 7 shows a flow 700 of the mobile device 100 executing the camera application to perform the flash coordination. In step 702, the user of the mobile device 100 executes the photographing application and turns on the camera lens of the mobile device 100 to focus on the photographing body 210 and perform exposure.

In step 704, the camera application determines whether to obtain the location information of the mobile device 100. If the location information of the mobile device 100 is successfully obtained, the process 700 continues to step 706; otherwise, the process 700 returns to step 702.

The camera application receives 706 location messages of other mobile devices that may communicate with the mobile device 100 and builds 708 a map that includes the location messages of the mobile device 100 and the other mobile devices, the indicated direction of movement, and the distances of the mobile devices from the photographic subject 210.

In step 710, the camera application determines whether light is needed for supplementary lighting. If the photographing application determines that light supplement is not required, the process 700 continues to step 712, the camera module 130 finishes photographing according to a general procedure, and the process 700 ends. If the camera application determines that the lighting conditions are not good and light compensation is required, the process 700 continues to step 714.

At step 714, the camera application presents a user interface on the screen of the mobile device 100 for the user to select one or more mobile devices near the suggested location to support the off-the-air flashing. When receiving the selection input of the user, a group of selected mobile devices is identified, and then the user interface is switched to the photographing interface. When the user touches the photo icon of the photo interface, a cooperative flashing request is sent to each selected mobile device and a location-indicating message is sent at step 716.

In step 718, the camera application determines whether all replies have been received from all selected mobile devices. If the camera application receives replies from all selected mobile devices, the process 700 continues to step 720; otherwise, the process 700 returns to step 714 for user reselection.

Step 720, the mobile device 100 and each selected mobile device are synchronized in time, so that each selected mobile device is also synchronized to flash while the mobile device 100 takes a picture of the main subject 210.

in step 722, while the mobile device 100 takes a picture, each selected mobile device is also flashed in conjunction with the off-line flash.

In step 724, the mobile device 100 can share photos through the wireless communication module 160.

At step 726, the camera application prompts the user if another photograph of the photographic subject 210 is desired. If the user decides to shoot again, the process 700 returns to step 714; otherwise, the above flow 700 ends.

Fig. 8 is a specific process 800 of the photographing application determining whether light supplement is required and providing a suggested flash position in step 710. In step 802, the photography application determines whether it is in a low light environment with insufficient light. If so, the process 800 continues to step 810, where the direct rear and the oblique rear of the photographic subject 210 are marked as suggested positions for the off-hook flash on the user interface, where the oblique rear can be the left rear or the right rear; otherwise, the flow 800 continues to step 804.

In step 804, the camera application further determines whether the hue deviation is too large due to the ambient light source. If the deviation of the displayed hue of the pre-taken picture is too large, the process 800 continues to step 810; otherwise, the process 800 continues to step 806.

At step 806, the camera application further determines whether a backlight capture condition exists. If the photographic subject 210 is in the backlight, the process 800 continues to step 812, where the left and right sides of the photographic subject 210 are marked on the user interface as suggested locations for the off-the-air flash; otherwise, the flow 800 continues to step 808.

step 808, the camera application further determines whether there is a situation with a light contrast ratio that is greater than the scene light source. If the pre-shot picture shows non-uniform brightness and greater contrast, the process 800 continues to step 814 where the shadow of the scene in which the subject 210 is located is marked on the user interface as the suggested location for the off-hook flash; otherwise, the process 800 ends.

the camera application further marks the mobile device on the user interface in close proximity to the suggested location, step 816.

FIG. 9 shows a process 900 for performing a coordinated flash for each selected mobile device. Step 902, the selected mobile device receives a cooperative flash request from the mobile device 100.

At step 904, the camera application executing on the selected mobile device prompts the user whether to accept the collaborative flash request. If the user of the selected mobile device accepts the collaborative flash request, the process 900 continues to step 906; otherwise, the process 900 ends.

In step 906, the camera application executed on the selected mobile device prompts the user via the user interface to direct the camera and flash of the selected mobile device to the photographic subject 210.

Step 908, the camera application executing on the selected mobile device further prompts the user to move to the indicated location in the collaborative flash request and returns to the mobile device 100 when the selected mobile device is at the indicated location.

In step 910, the selected mobile device completes time synchronization with the mobile device 100 and receives the photographing time.

In step 912, the selected mobile device flashes while the mobile device 100 takes a picture, thereby completing the process 900.

To summarize, the collaborative flash mechanism implemented by software is easy to use and relieves the burden of purchasing one or more off-line flash devices. The cooperative flashing also makes up for the deficiencies of the flashing module 140 of the mobile device 100. In a shooting scene, a plurality of mobile devices can shoot photos with ideal lighting conditions in cooperation with flash, and the photos shot at different angles can be shared with each other.

It should be noted that the above embodiments are only for illustrating the technical solutions of the present invention and not for limiting, and although the present invention is described in detail with reference to the preferred embodiments, it should be understood by those skilled in the art that modifications or equivalent substitutions may be made to the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention.