阅读说明：本技术 一种设置摄像头启动配置的方法、装置和电子设备 (Method and device for setting camera starting configuration and electronic equipment ) 是由 高尚 于 2020-03-23 设计创作，主要内容包括：本申请实施例提供一种设置摄像头启动配置的方法、装置和电子设备。方法包括：在执行图像采集操作的过程中,判断是否存在执行摄像头切换操作的应用需求,所述摄像头切换操作为将使用第一摄像头执行所述图像采集操作切换为使用第二摄像头执行所述图像采集操作；当存在所述应用需求时,在执行所述摄像头切换操作之前,将所述第二摄像头由默认启动配置调整为第一启动配置,使得在执行所述摄像头切换操作之后,所述第二摄像头基于所述第一启动配置开始执行所述图像采集操作。根据本申请实施例的方法,可以有效减小摄像头切换操作前后图像采集结果的差异度,从而提高用户的视觉体验。(The embodiment of the application provides a method and a device for setting starting configuration of a camera and electronic equipment. The method comprises the following steps: in the process of executing image acquisition operation, judging whether an application requirement for executing camera switching operation exists, wherein the camera switching operation is to switch the execution of the image acquisition operation by using a first camera to the execution of the image acquisition operation by using a second camera; when the application requirement exists, before the camera switching operation is executed, the second camera is adjusted to be in a first starting configuration from a default starting configuration, so that after the camera switching operation is executed, the second camera starts to execute the image acquisition operation based on the first starting configuration. According to the method, the difference degree of the image acquisition results before and after the camera switching operation can be effectively reduced, and therefore the visual experience of a user is improved.)

1. A method for setting camera startup configuration is characterized by comprising the following steps:

in the process of executing image acquisition operation, judging whether an application requirement for executing camera switching operation exists, wherein the camera switching operation is to switch the execution of the image acquisition operation by using a first camera to the execution of the image acquisition operation by using a second camera;

when the application requirement exists, before the camera switching operation is executed, the second camera is adjusted from a default starting configuration to a first starting configuration, so that after the camera switching operation is executed, the second camera starts to execute the image acquisition operation based on the first starting configuration, wherein:

after the camera switching operation is executed, the difference degree of image acquisition results before and after the camera switching operation caused by the fact that the second camera starts to execute the image acquisition operation based on the first starting configuration is a first difference degree;

after the camera switching operation is executed, the difference degree of the image acquisition result of the second camera before and after the camera switching operation caused by starting to execute the image acquisition operation based on the default starting configuration is a second difference degree;

the first degree of difference is less than the second degree of difference.

2. The method of claim 1, wherein determining whether an application requirement exists for performing a camera switching operation comprises:

and judging whether the switching requirement exists according to the input operation of the user in the image acquisition operation.

3. The method of claim 1 or 2, wherein adjusting the second camera from a default startup configuration to a first startup configuration comprises:

confirming an optical axis offset parameter corresponding to the camera switching operation;

and moving the optical axis of the second camera according to the optical axis deviation parameter.

4. The method according to claim 3, wherein an optical axis shift parameter corresponding to the camera switching operation is confirmed, wherein:

and calculating the optical axis deviation parameter according to the position relation between the first camera and the second camera and the shooting distance of the shooting object.

5. The method according to claim 3, wherein an optical axis shift parameter corresponding to the camera switching operation is confirmed, wherein:

and calling an optical axis offset parameter corresponding to the camera switching operation from a pre-stored configuration library.

6. The method according to any one of claims 3 to 5, wherein the optical axis offset parameters include a lens pull-off direction and an offset, and moving the optical axis of the second camera according to the optical axis offset parameters comprises:

and according to the lens deviation direction and the deviation amount, the lens of the second camera is deviated so as to realize the movement of the optical axis.

7. The method of claim 1 or 2, wherein adjusting the second camera from a default startup configuration to a first startup configuration comprises:

determining a first working parameter according to the current working parameter of the first camera;

and adjusting the starting working parameters of the second camera to the first working parameters.

8. The method according to any one of claims 1 to 7, further comprising:

and in the process of executing the image acquisition operation by using a second camera, restoring the working parameters of the second camera from the first starting configuration to the default starting configuration.

9. An apparatus for setting a camera start-up configuration, comprising:

the monitoring module is used for judging whether an application requirement for executing camera switching operation exists in the process of executing image acquisition operation, and the camera switching operation is to switch from executing the image acquisition operation by using a first camera to executing the image acquisition operation by using a second camera;

a configuration adjustment module, configured to, when the application requirement exists, adjust the second camera from a default startup configuration to a first startup configuration before performing the camera switching operation, so that after performing the camera switching operation, the second camera starts performing the image capturing operation based on the first startup configuration, where:

before the camera switching operation is executed, the first camera acquires a first image acquisition result;

when the second camera is in the first starting configuration, after the camera switching operation is executed, the second camera acquires a second image acquisition result;

when the second camera is in the default starting configuration, after the camera switching operation is executed, the second camera acquires a third image acquisition result;

the image difference between the second image acquisition result and the first image acquisition result is lower than the image difference between the third image acquisition result and the first image acquisition result.

10. An electronic device, comprising a memory for storing computer program instructions and a processor for executing the program instructions, wherein the computer program instructions, when executed by the processor, trigger the electronic device to perform the method steps of any of claims 1 to 8 below.

11. A computer-readable storage medium, in which a computer program is stored which, when run on a computer, causes the computer to carry out the method according to any one of claims 1 to 8.

Technical Field

The application relates to the technical field of intelligent terminals, in particular to a method and a device for setting starting configuration of a camera and electronic equipment.

Background

In the application scenario of the prior art, in order to implement an image capturing function, a camera is usually installed on a mobile device (e.g., a mobile phone, a tablet computer, a notebook computer, etc.). Because the internal space of the mobile equipment is limited, the camera installed in the mobile equipment has strict size limitation, so that the performance parameters of the camera of the mobile equipment, such as focal length adjusting range, aperture adjusting range and light angle, are far lower than the performance standards of a professional camera, and the camera of the mobile equipment cannot meet the requirements of changeable camera application scenes.

In view of the above problems, one of the feasible solutions adopted in the prior art is a multi-camera solution, in which a plurality of cameras are installed on a mobile device, and different cameras have different performance parameters. Different cameras are used for different camera shooting application scenes, and the integration of the acquisition results of the multiple cameras is utilized to meet the changeable camera shooting application scene requirements.

Although the multi-camera scheme can meet the requirements of changeable shooting application scenes, in actual use, the situation that different cameras have obvious difference between images collected by aiming at the same shooting target exists. Therefore, when the image acquisition result of the camera is displayed in real time through the display screen, if the camera is switched, the images displayed by the display screen may have obvious difference before and after the camera is switched, and the visual experience of a user is greatly influenced.

Disclosure of Invention

The application provides a method and a device for setting camera starting configuration and electronic equipment, and also provides a computer readable storage medium for setting the camera starting configuration, so that the difference of image acquisition results before and after camera switching is reduced, and the visual experience of a user is improved.

Aiming at the problem that the image acquisition results are obviously different before and after the camera switching operation, the embodiment of the application adopts the following technical scheme:

in a first aspect, an embodiment of the present application provides a method for setting a camera start configuration, including:

in the process of executing image acquisition operation, judging whether an application requirement for executing camera switching operation exists, wherein the camera switching operation is to switch the execution of the image acquisition operation by using a first camera to the execution of the image acquisition operation by using a second camera;

when the application requirement exists, before the camera switching operation is executed, the second camera is adjusted from a default starting configuration to a first starting configuration, so that after the camera switching operation is executed, the second camera starts to execute the image acquisition operation based on the first starting configuration, wherein:

after the camera switching operation is executed, the difference degree of image acquisition results before and after the camera switching operation caused by the fact that the second camera starts to execute the image acquisition operation based on the first starting configuration is a first difference degree;

after the camera switching operation is executed, the difference degree of the image acquisition result of the second camera before and after the camera switching operation caused by starting to execute the image acquisition operation based on the default starting configuration is a second difference degree;

the first degree of difference is less than the second degree of difference.

According to the method and the process of the first aspect, the difference degree of the image acquisition results before and after the camera switching operation can be effectively reduced, and therefore the visual experience of a user is improved.

In an implementation manner based on the first aspect, determining whether there is an application requirement for executing a camera switching operation includes:

and judging whether the switching requirement exists according to the input operation of the user in the image acquisition operation.

In an implementation manner based on the first aspect, adjusting the second camera from a default startup configuration to a first startup configuration includes:

confirming an optical axis offset parameter corresponding to the camera switching operation;

and moving the optical axis of the second camera according to the optical axis deviation parameter.

In one implementation manner based on the first aspect, an optical axis offset parameter corresponding to the camera switching operation is confirmed, where:

and calculating the optical axis deviation parameter according to the position relation between the first camera and the second camera and the shooting distance of the shooting object.

In one implementation manner based on the first aspect, an optical axis offset parameter corresponding to the camera switching operation is confirmed, where:

and calling an optical axis offset parameter corresponding to the camera switching operation from a pre-stored configuration library.

In an implementation manner based on the first aspect, the optical axis offset parameter includes a lens pull-out direction and an offset, and moving the optical axis of the second camera according to the optical axis offset parameter includes

And according to the lens deviation direction and the deviation amount, the lens of the second camera is deviated so as to realize the movement of the optical axis.

In an implementation manner based on the first aspect, adjusting the second camera from a default startup configuration to a first startup configuration includes:

determining a first working parameter according to the current working parameter of the first camera;

and adjusting the starting working parameters of the second camera to the first working parameters.

In one implementation form based on the first aspect, the method further includes:

and in the process of executing the image acquisition operation by using a second camera, restoring the working parameters of the second camera from the first starting configuration to the default starting configuration.

In a second aspect, an embodiment of the present application provides an apparatus for setting a camera start configuration, including:

the monitoring module is used for judging whether an application requirement for executing camera switching operation exists in the process of executing image acquisition operation, and the camera switching operation is to switch from executing the image acquisition operation by using a first camera to executing the image acquisition operation by using a second camera;

a configuration adjustment module, configured to, when the application requirement exists, adjust the second camera from a default startup configuration to a first startup configuration before performing the camera switching operation, so that after performing the camera switching operation, the second camera starts performing the image capturing operation based on the first startup configuration, where:

before the camera switching operation is executed, the first camera acquires a first image acquisition result;

when the second camera is in the first starting configuration, after the camera switching operation is executed, the second camera acquires a second image acquisition result;

when the second camera is in the default starting configuration, after the camera switching operation is executed, the second camera acquires a third image acquisition result;

the image difference between the second image acquisition result and the first image acquisition result is lower than the image difference between the third image acquisition result and the first image acquisition result.

In a third aspect, embodiments of the present application provide an electronic device, which includes a memory for storing computer program instructions and a processor for executing the program instructions, wherein the computer program instructions, when executed by the processor, trigger the electronic device to perform the method steps of the embodiments of the present application.

In a fourth aspect, the present application provides a computer-readable storage medium, in which a computer program is stored, and when the computer program runs on a computer, the computer program causes the computer to execute the method of the present application.

Drawings

FIG. 1 is a flow chart illustrating an embodiment of a method for setting camera startup configuration according to the present application;

FIG. 2 is a schematic diagram showing the imaging results of cameras in different positions;

FIG. 3 is a schematic diagram showing the imaging results of cameras in different positions;

fig. 4 is a block diagram of an embodiment of an apparatus for setting a camera activation configuration according to the present application.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be described in detail and completely with reference to the following specific embodiments of the present application and the accompanying drawings. It should be apparent that the described embodiments are only some of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terminology used in the description of the embodiments section of the present application is for the purpose of describing particular embodiments of the present application only and is not intended to be limiting of the present application.

The embodiment of the application provides a method for setting camera starting configuration, aiming at the problem that image acquisition results are obviously different before and after camera switching operation. In an embodiment of the present application, in an image capturing operation execution process, it is assumed that a currently used camera is a first camera, and it is required to switch to use a second camera, and before switching the cameras, a start configuration of the second camera is adjusted in advance, so that after the cameras are switched, an image captured when the second camera is started is as consistent as possible with an image captured before the cameras are switched, by the first camera. Therefore, the difference degree of the image acquisition results before and after the camera is switched to operate is greatly reduced, and the user experience is effectively improved.

The execution flow of the embodiment of the method for setting the starting configuration of the camera according to the present application is described in detail below through a specific application scenario.

In an application scenario according to an embodiment of the present application, the mobile device is configured with a plurality of cameras, where the plurality of cameras includes at least a first camera and a second camera (the first camera and the second camera may be any two of the plurality of cameras). An image capture application of the mobile device performs image capture operations using the camera. When the image capture application performs an image capture operation using the first camera, it may also perform a camera switching operation (switching from performing the image capture operation using the first camera to performing the image capture operation using the first camera). When the image acquisition application starts the second camera, the default starting configuration of the second camera is a preset starting configuration, and when the starting configuration is not adjusted, the second camera starts to execute the image acquisition operation by adopting the default starting configuration.

Fig. 1 is a flowchart illustrating an embodiment of a method for setting a camera start-up configuration according to the present application. In this embodiment, the image capture application of the mobile device performs the following steps as shown in fig. 1 to implement the image capture operation:

step 100, executing image acquisition operation by using a first camera;

step 110, in the execution process of step 100, judging whether an application requirement for executing camera switching operation exists;

if the application requirement for executing the camera switching operation does not exist, returning to the step 100;

if an application requirement for executing the camera switching operation exists, before the camera switching operation is executed, executing step 120, and adjusting the second camera from the default starting configuration to the first starting configuration, so that after the camera switching operation is executed, the second camera starts to execute the image acquisition operation based on the first starting configuration;

and step 130, executing a camera switching operation, and switching to execute the image acquisition operation by using the first camera.

Based on the above-described flow steps, after performing step 130, the second camera starts performing image capturing operations based on the first start-up configuration. The difference between the image capturing results before and after the step 130 is executed is the first difference. If the start-up configuration of the second camera is not adjusted, after step 100 is executed, steps 110 and 120 are skipped, and step 130 is directly executed, the second camera starts to execute the image capturing operation based on the default start-up configuration. In this case, the difference between the image capturing results before and after the step 130 is performed is the second difference.

If the first difference is smaller than the second difference, it is shown that the difference of the image acquisition results before and after the camera switching operation is effectively reduced by the scheme of the embodiment (performing 100-130 shown in fig. 1) compared to the scheme of not adjusting the start configuration of the second camera (skipping steps 110 and 120). Therefore, in this embodiment, the parameters of the first start-up configuration are configured such that the first degree of difference is smaller than the second degree of difference. According to the method flow shown in the embodiment of fig. 1, the difference degree of the image acquisition results before and after the camera switching operation can be effectively reduced, so that the visual experience of a user is improved.

It is to be understood that some or all of the steps or operations in the above-described embodiments are merely examples, and other operations or variations of various operations may be performed by the embodiments of the present application. Further, the various steps may be performed in a different order presented in the above-described embodiments, and it is possible that not all of the operations in the above-described embodiments are performed.

Further, in the actual implementation process, the steps of the embodiment shown in fig. 1 may have a variety of different implementations. The following describes, by way of example, the implementation of the steps of the embodiment shown in fig. 1.

Specifically, in an implementation manner of step 110, in the process of determining whether there is an application requirement for executing the camera switching operation, it is determined whether there is an application requirement for executing the camera switching operation according to an input operation of the user in the image capturing operation.

For example, in an application scenario, cameras of different zoom ranges are arranged, and different cameras are switched when zooming is performed to achieve a wider zoom range. For example, a camera a1 for long-range shooting and a camera a2 for short-range shooting are provided, and when the focus adjustment is adjusted from long-range shooting to short-range shooting, the camera a1 is switched to the camera a 2. In the application scene, a user uses image acquisition software to realize image acquisition operation, the user executes focusing operation in the image acquisition process, and when an adjustment target corresponding to the focusing operation of the user exceeds the focal length adjustable range of the current camera, the image acquisition software needs to execute camera switching operation. Therefore, when the adjustment target corresponding to the focusing operation of the user exceeds the focus adjustable range of the current camera, it can be determined that the application requirement for executing the camera switching operation exists.

Further, in an actual application scenario, before the camera switching operation is executed, the operating parameters (e.g., aperture, focal length, etc.) of the camera used in the image capturing operation are determined by the application requirements of the current image capturing operation. After the camera switching operation is executed, a new camera is started in the image acquisition operation, the newly started camera usually starts to work by adopting preset initial working parameters, and due to the fact that the preset initial working parameters are different from the working parameters determined by the application requirements of the current image acquisition operation, the image acquisition results before and after the camera switching operation are different. For example, after the camera switching operation is performed, there occurs a significant change in image brightness and/or a significant change in image focus.

Based on the above analysis, in one implementation of step 120, the image capture application of the mobile device performs the following steps when performing step 120:

determining a first working parameter according to the current working parameter of the first camera;

and adjusting the starting working parameters of the second camera to be the first working parameters.

According to the implementation manner of step 120 in the above embodiment, the cameras used before and after the camera switching operation can be made to work under the consistent working parameters, so that the difference of the image acquisition results before and after the camera switching operation is reduced.

Further, in an actual application scenario, the reason why the difference exists between the image acquisition results before and after the switching operation of the cameras also includes the difference of physical positions of different cameras. For example, a zoom shooting scheme with multiple cameras is adopted for mobile equipment, and due to the difference in physical positions of different camera modules on the same mobile phone, a shot picture has a view field difference when being switched between different cameras, and the difference becomes more obvious along with the increase of a focal length, so that a user can see obvious picture jitter in the process of changing the focal length when shooting preview or video recording.

Take a specific application scenario as an example. Fig. 2 is a schematic diagram showing the imaging results of the cameras in different positions. As shown in fig. 2, the upper and lower cameras are the camera 201 and the camera 202, respectively, the object to be captured is the bulb 203, and the imaging results of the camera 201 and the camera 202 are the screen 211 and the screen 212, respectively. Due to the difference in physical positions of the camera 201 and the camera 202, the positions of the subject bulb 203 displayed on the screen 211 and the screen 212 are not consistent.

In the application scenario, if the camera used by the image capturing application is switched from the camera 201 to the camera 202, the display screen of the mobile device is also switched from the screen 211 to the screen 212, and the user may observe that the subject bulb 203 has a distinct jump on the display screen, which destroys the consistency of the screen.

Based on the above analysis, in an embodiment of the present application, the difference in image acquisition results before and after the camera switching operation due to the difference in the physical positions of the cameras is eliminated/mitigated by adjusting the second camera from the default startup configuration to the first startup configuration.

Specifically, in an actual application scenario, the optical axis is a connection line of optical centers of the lenses in the camera lens. The optical axis is perpendicular to the photosensitive device in a stable state and is close to the central position of an imaging area of the photosensitive device. On a mobile device supporting Optical Image Stabilization (OIS), a lens of a camera mounted on the mobile device can move away from an original Optical axis within a certain range, a new Optical axis is equivalently formed after the lens moves, and a shot object can generate an image of a new position on a photosensitive device through a new Optical axis path. In an embodiment of the application, imaging differences caused by different physical positions of the cameras are eliminated/relieved by moving the optical axis.

Take a specific application scenario as an example. Fig. 3 is a schematic diagram showing the imaging results of the cameras in different positions. As shown in fig. 3, the upper and lower cameras are a camera 301 and a camera 302, respectively, the object to be captured is a light bulb 303, and the imaging results of the camera 301 and the camera 302 are a screen 311 and a screen 312, respectively. The original optical axis of the camera 302 is 321, and the moved optical axis is 322. The screen 312 is an imaging result based on the moved optical axis 322. The position difference of the light bulb 303 in the frame 311 and the frame 312 shown in fig. 3 is significantly smaller than the position difference of the light bulb 203 in the frame 211 and the frame 212 shown in fig. 2.

Specifically, in one implementation of step 120, the image capture application of the mobile device performs the following steps when performing step 120:

confirming an optical axis offset parameter corresponding to the switching operation of the camera;

and moving the optical axis of the second camera according to the confirmed optical axis deviation parameter.

Further, in practical application scenarios, the movement of the optical axis is realized by pulling the deflection lens. Specifically, in an implementation manner of step 120, the optical axis deviation parameter includes a lens deviation direction and an offset, and when the image acquisition application of the mobile device moves the optical axis of the second camera according to the optical axis deviation parameter, the lens of the second camera is deviated according to the lens deviation direction and the offset to realize the movement of the optical axis.

Taking a specific application scenario as an example, when the image acquisition application pre-judges that a need for switching the camera may occur when a user shoots (for example, the user enlarges or reduces a shot picture by operating an icon on a mobile phone interface, and the operation corresponds to the change of different equivalent focal lengths caused by switching different cameras by the mobile phone), the OIS optical anti-shake device in the camera to be switched is started, the lens is pulled to a certain position by a motor/electromagnetic force and the like in the camera, the optical axis of actual imaging of the camera is changed, and thus the imaging position of the shot picture by the camera is changed.

Further, in an implementation manner of step 120, the optical axis offset parameter corresponding to the camera switching operation is confirmed through a real-time calculation manner. Specifically, the image capturing application of the mobile device performs the following steps when performing step 120:

and calculating an optical axis offset parameter according to the position relation between the first camera and the second camera and the shooting distance of the shooting object.

Further, in an implementation manner of step 120, the optical axis offset parameter corresponding to the camera switching operation is confirmed by calling a preset value. Specifically, the image capturing application of the mobile device performs the following steps when performing step 120:

and calling an optical axis offset parameter corresponding to the camera switching operation from a pre-stored configuration library.

Taking a specific application scenario as an example, the preset value of the optical axis deviation parameter is given by performing algorithm calibration in the production process of the mobile device. The preset value is corresponding to different shooting distances and gives corresponding numerical value.

Further, considering that in an actual application scenario, the control of the camera is usually configured with a preset default starting configuration, i.e. an adjustment reference, in an embodiment of the present application, after step 130, the image capturing application further performs the following steps:

and in the process of executing the image acquisition operation by using the second camera, restoring the working parameters of the second camera from the first starting configuration to the default starting configuration.

Taking a specific application scenario as an example, after the camera is switched, the OIS optical anti-shake apparatus slowly restores the position of the lens by changing the motor/electromagnetic force, so that the optical axis is slowly restored to the previous normal position, and then continues to operate in the normal mode.

Based on the method for setting the starting configuration of the camera provided by the embodiment of the application, an embodiment of the application also provides a device for setting the starting configuration of the camera. Fig. 4 is a block diagram of an embodiment of an apparatus for setting a camera activation configuration according to the present application. In an embodiment of the present application, as shown in fig. 4, in an embodiment of the present application, an apparatus 400 for setting a camera activation configuration includes:

the monitoring module 410 is configured to determine whether an application requirement exists for executing a camera switching operation in the process of executing an image capturing operation, where the camera switching operation is to switch from executing the image capturing operation by using a first camera to executing the image capturing operation by using a second camera;

a configuration adjusting module 420, configured to, when there is an application demand for performing a camera switching operation, adjust the second camera from the default startup configuration to the first startup configuration before performing the camera switching operation, so that after performing the camera switching operation, the second camera starts to perform the image capturing operation based on the first startup configuration, wherein:

before executing camera switching operation, a first camera acquires a first image acquisition result;

when the second camera is in the first starting configuration, after the camera switching operation is executed, the second camera acquires a second image acquisition result;

when the second camera is in the default starting configuration, after the camera switching operation is executed, the second camera acquires a third image acquisition result;

the image difference between the second image acquisition result and the first image acquisition result is lower than the image difference between the third image acquisition result and the first image acquisition result.

The apparatus provided in the embodiment of the present application shown in fig. 4 may be used to implement the technical solution of the method embodiment of the present application, and the implementation principle and technical effect of the apparatus may further refer to the related description in the method embodiment.

Further, in the 90 s of the 20 th century, improvements in a technology could clearly distinguish between improvements in hardware (e.g., improvements in circuit structures such as diodes, transistors, switches, etc.) and improvements in software (improvements in process flow). However, as technology advances, many of today's process flow improvements have been seen as direct improvements in hardware circuit architecture. Designers almost always obtain the corresponding hardware circuit structure by programming an improved method flow into the hardware circuit. Thus, it cannot be said that an improvement in the process flow cannot be realized by hardware physical modules. For example, a Programmable Logic Device (PLD), such as a Field Programmable Gate Array (FPGA), is an integrated circuit whose Logic functions are determined by programming the Device by an accessing party. A digital device is "integrated" on a PLD by the designer's own programming without requiring the chip manufacturer to design and fabricate a dedicated integrated circuit chip. Furthermore, nowadays, instead of manually making an Integrated Circuit chip, such Programming is often implemented by "logic compiler" software, which is similar to a software compiler used in program development and writing, but the original code before compiling is also written by a specific Programming Language, which is called Hardware Description Language (HDL), and HDL is not only one but many, such as abel (advanced Boolean Expression Language), ahdl (alternate Hardware Description Language), traffic, pl (core universal Programming Language), HDCal (jhdware Description Language), lang, Lola, HDL, laspam, hardward Description Language (vhr Description Language), vhal (Hardware Description Language), and vhigh-Language, which are currently used in most common. It will also be apparent to those skilled in the art that hardware circuitry that implements the logical method flows can be readily obtained by merely slightly programming the method flows into an integrated circuit using the hardware description languages described above.

The controller may be implemented in any suitable manner, for example, the controller may take the form of, for example, a microprocessor or processor and a computer-readable medium storing computer-readable program code (e.g., software or firmware) executable by the (micro) processor, logic gates, switches, an Application Specific Integrated Circuit (ASIC), a programmable logic controller, and an embedded microcontroller, examples of which include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320, the memory controller may also be implemented as part of the control logic for the memory. Those skilled in the art will also appreciate that, in addition to implementing the controller as pure computer readable program code, the same functionality can be implemented by logically programming method steps such that the controller is in the form of logic gates, switches, application specific integrated circuits, programmable logic controllers, embedded microcontrollers and the like. Such a controller may thus be considered a hardware component, and the means included therein for performing the various functions may also be considered as a structure within the hardware component. Or even means for performing the functions may be regarded as being both a software module for performing the method and a structure within a hardware component.

In the description of the embodiments of the present application, for convenience of description, the device is described as being divided into various modules/units by functions, the division of each module/unit is only a division of logic functions, and the functions of each module/unit can be implemented in one or more pieces of software and/or hardware when the embodiments of the present application are implemented.

Specifically, the apparatuses proposed in the embodiments of the present application may be wholly or partially integrated into one physical entity or may be physically separated when actually implemented. And these modules can be realized in the form of software called by processing element; or may be implemented entirely in hardware; and part of the modules can be realized in the form of calling by the processing element in software, and part of the modules can be realized in the form of hardware. For example, the detection module may be a separate processing element, or may be integrated into a chip of the electronic device. Other modules are implemented similarly. In addition, all or part of the modules can be integrated together or can be independently realized. In implementation, each step of the above method or each module above may be implemented by an integrated logic circuit of hardware in a processor element or an instruction in the form of software.

For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as: one or more Application Specific Integrated Circuits (ASICs), or one or more Digital Signal Processors (DSPs), or one or more Field Programmable Gate Arrays (FPGAs), etc. For another example, these modules may be integrated together and implemented in the form of a System-On-a-Chip (SOC).

An embodiment of the present application further provides an electronic device, which includes a memory for storing computer program instructions and a processor for executing the program instructions, wherein the computer program instructions, when executed by the processor, trigger the electronic device to perform the method steps described in the embodiments of the present application.

The electronic devices, apparatuses, modules or units illustrated in the embodiments of the present application may be specifically implemented by a computer chip or an entity, or implemented by a product with certain functions. A typical implementation device is a computer, which may be, for example, a desktop computer, a laptop computer, a tablet computer, a cell phone, a personal digital assistant, a media player, a navigation device, a game console, a wearable device, or a combination of any of these devices. Specifically, in an embodiment of the present application, the electronic device may be a terminal device, for example, a mobile terminal (a mobile phone, a tablet computer, a notebook computer), a local terminal (a personal/industrial computer), a cloud server, and the like; or may be a circuit device built in the terminal device.

Further, in an embodiment of the present application, a processor of the electronic device may be an on-chip device SOC, and the processor may include one or more processing units, such as: the Processor may include a Central Processing Unit (CPU), a DSP, a microcontroller, an Application Processor (AP), a Graphics Processing Unit (GPU), an embedded Neural Network Processor (NPU), an Image Signal Processor (ISP), a modem Processor, a video codec, a baseband Processor, a Pulse Width Modulation (PWM) controller, and may further include other types of processors. The different processing units may be separate devices or may be integrated into one or more processors. The controller in the processor can generate operation control signals according to the instruction operation codes and the time sequence signals to complete the control of instruction fetching and instruction execution.

Further, in an embodiment of the present application, the processor may further include a necessary hardware accelerator or a logic processing hardware circuit, such as an ASIC, or one or more integrated circuits for controlling the execution of the program according to the present application. Further, the processor may have the functionality to operate one or more software programs, which may be stored in the storage medium.

Further, in one embodiment of the present application, the memory of the electronic device includes permanent and non-permanent, removable and non-removable computer-readable media that can implement the storage of information by any method or technology. The information stored by the computer-readable medium of the memory may be computer-readable instructions, data structures, modules of a program, or other data.

Examples of computer readable media for constructing the memory include, but are not limited to: Read-Only Memory (ROM), other types of static storage devices that may store static information and instructions, Random Access Memory (RAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), phase-change Memory (PRAM), Static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), flash Memory or other Memory technology Memory, Compact Disc Read-Only Memory (CD-ROM), Digital Versatile Disc (DVD) or other optical storage (including Compact Disc, laser Disc, optical Disc, digital versatile Disc, blu-ray Disc, etc.), magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium or media capable of storing program code and capable of being accessed by a computing device.

Further, in an embodiment of the present application, the processor and the memory may be combined into a processing device, and more generally, independent components, and the processor is configured to execute the program code stored in the memory to implement the method of the embodiment of the present application. In particular implementations, the memory may be integrated within the processor or may be separate from the processor. A memory may also be provided in the processor for storing instructions and data. In some embodiments, the memory in the processor is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor. If the processor needs to reuse the instruction or data, it can be called directly from memory.

Further, in some embodiments, processor 110 may include one or more interfaces. The Interface may include an Integrated Circuit (I2C) Interface, an Inter-Integrated Circuit built-in audio (I2S) Interface, a Pulse Code Modulation (PCM) Interface, a universal asynchronous receiver/transmitter (UART) Interface, a Mobile Industry Processor Interface (MIPI), a General-Purpose Input/Output (GPIO) Interface, a Subscriber Identity Module (SIM) Interface, and/or a USB Interface, etc.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, apparatus, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media having computer-usable program code embodied in the medium.

In the several embodiments provided in the present application, any function, if implemented in the form of a software functional unit and sold or used as a separate product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application.

Specifically, an embodiment of the present application further provides a computer-readable storage medium, in which a computer program is stored, and when the computer program runs on a computer, the computer is caused to execute the method provided by the embodiment of the present application.

An embodiment of the present application further provides a computer program product, which includes a computer program, when it runs on a computer, causes the computer to execute the method provided by the embodiment of the present application.

The embodiments herein are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (devices), and computer program products according to embodiments herein. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In the embodiments of the present application, "at least one" means one or more, "and" a plurality "means two or more. "and/or" describes the association relationship of the associated objects, and means that there may be three relationships, for example, a and/or B, and may mean that a exists alone, a and B exist simultaneously, and B exists alone. Wherein A and B can be singular or plural. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. "at least one of the following" and similar expressions refer to any combination of these items, including any combination of singular or plural items. For example, at least one of a, b, and c may represent: a, b, c, a and b, a and c, b and c or a and b and c, wherein a, b and c can be single or multiple.

In the embodiments of the present application, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.

The application may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The application may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.

The embodiments in the present application are described in a progressive manner, and the same and similar parts among the embodiments can be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the apparatus embodiment, since it is substantially similar to the method embodiment, the description is relatively simple, and for the relevant points, reference may be made to the partial description of the method embodiment.

Those of ordinary skill in the art will appreciate that the various elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of electronic hardware and computer software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described apparatuses, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.

While the embodiments of the present invention have been described with reference to the accompanying drawings, it will be understood by those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined by the appended claims. The protection scope of the present application shall be subject to the protection scope of the claims.