阅读说明：本技术 利用电子笔控制操作模式的方法及电子装置 (Method for controlling operation mode by using electronic pen and electronic device ) 是由 辛相旻 康智光 尹汝正 林然旭 于 2019-07-24 设计创作，主要内容包括：提供了一种用于检测电子装置中的动态图像内容的黑区的设备和方法。所述电子装置可以包括：壳体；显示装置,所述显示装置通过所述壳体的一部分暴露；凹部,所述凹部设置在所述壳体内部并沿着所述壳体的长度延伸；电子笔,所述电子笔可插入到所述凹部中并且可从所述凹部移出；至少一个处理器,所述至少一个处理器位于所述壳体内部并可操作地连接到所述显示装置；以及存储器,所述存储器可操作地连接到所述至少一个处理器。所述存储器存储有指令,所述指令在被执行时使得所述至少一个处理器执行如下操作：识别在低功率模式下所述电子笔是否从所述凹部移出；当所述电子笔从所述凹部移出时,接收与所述电子笔有关的信息；基于与所述电子笔有关的所述信息的至少一部分来执行应用。(An apparatus and method for detecting a black region of moving image content in an electronic device are provided. The electronic device may include: a housing; a display device exposed through a portion of the housing; a recess disposed inside the housing and extending along a length of the housing; an electronic pen insertable into and removable from the recess; at least one processor located inside the housing and operatively connected to the display device; and a memory operatively connected to the at least one processor. The memory stores instructions that, when executed, cause the at least one processor to: identifying whether the electronic pen is removed from the recess in a low power mode; receiving information related to the electronic pen when the electronic pen is removed from the recess; executing an application based on at least a portion of the information related to the electronic pen.)

1. An electronic device, the electronic device comprising:

a housing;

a display device exposed through a portion of the housing;

a recess disposed inside the housing and extending along a length of the housing;

an electronic pen insertable into and removable from the recess;

at least one processor located inside the housing and operatively connected to the display device; and

a memory operatively connected to the at least one processor,

wherein the memory stores instructions that, when executed, configure the at least one processor to:

identifying whether the electronic pen is removed from the recess in a low power mode,

receiving information related to the electronic pen when the electronic pen is removed from the recess, and

executing an application based on at least a portion of the information related to the electronic pen.

2. The electronic device of claim 1, wherein the information related to the electronic pen comprises at least one of: whether a hovering input by the electronic pen is detected, a time point at which the hovering input is detected, an orientation of the electronic pen, or input information of a button included in the electronic pen.

3. The electronic device as set forth in claim 2,

wherein the housing includes wireless communication circuitry, and

wherein the instructions, when executed, further configure the at least one processor to: receiving at least one of an orientation of the electronic pen or input information of a button included in the electronic pen from the electronic pen through short-range wireless communication using the wireless communication circuit.

4. The electronic device of claim 3, wherein the short-range wireless communication comprises at least one of Bluetooth (BT) or Bluetooth Low Energy (BLE).

5. The electronic device of claim 2, wherein the instructions, when executed, further configure the at least one processor to:

acquiring input information of a button included in the electronic pen, and executing a memo application when the input information of the button included in the electronic pen satisfies a first predetermined condition; and

executing a camera application when input information of a button included in the electronic pen satisfies a second predetermined condition.

6. The electronic device as set forth in claim 5,

wherein the first predetermined condition includes a condition related to an input of a button of the electronic pen located within a hovering area, and

wherein the second predetermined condition comprises a condition relating to an input of a button of the electronic pen located outside the hovering area.

7. The electronic device of claim 2, wherein the instructions, when executed, further configure the at least one processor to:

identifying an orientation of the electronic pen;

executing a camera application when the orientation of the electronic pen is maintained in a first orientation for a predetermined time; and

executing a memo application when the orientation of the electronic pen is maintained in the second orientation for a predetermined time.

8. The electronic device of claim 7, wherein the instructions, when executed, further configure the at least one processor to: identifying an orientation of the electronic pen based on sensed data received from the electronic pen through the short-range wireless communication from a 6-axis sensor included in the electronic pen.

9. A method of operating an electronic device, the method comprising:

identifying whether an electronic pen is removed from a recess disposed inside a housing and extending along a length of the housing in a low power mode, wherein the electronic pen is insertable into and removable from the recess;

receiving information related to the electronic pen when the electronic pen is removed from the recess; and

executing an application based on at least a portion of the information related to the electronic pen.

10. The method of claim 9, wherein the information related to the electronic pen comprises at least one of: whether a hovering input by the electronic pen is detected, a time point at which the hovering input is detected, an orientation of the electronic pen, or input information of a button included in the electronic pen.

11. The method of claim 10, wherein identifying information related to the electronic pen comprises: receiving, with a wireless communication circuit of the electronic device, at least one of an orientation of the electronic pen and input information of a button included in the electronic pen from the electronic pen through short-range wireless communication.

12. An electronic device, the electronic device comprising:

a housing;

a display device exposed through a portion of the housing;

a recess disposed inside the housing and extending along a length of the housing;

an electronic pen insertable into and removable from the recess;

at least one processor located inside the housing and operatively connected to the display device; and

a memory operatively connected to the at least one processor,

wherein the memory stores instructions that, when executed, configure the at least one processor to:

generating content when input through the electronic pen is detected, and

executing an operational mode of the electronic device related to the content based on the orientation of the electronic pen.

13. The electronic device as set forth in claim 12,

wherein the housing includes wireless communication circuitry, and

wherein the instructions, when executed, further configure the at least one processor to: identifying an orientation of the electronic pen based on sensed data of a 6-axis sensor included in the electronic pen received from the electronic pen through the short-range wireless communication using the wireless communication circuit.

14. The electronic device of claim 12, wherein the instructions, when executed, further configure the at least one processor to:

controlling the electronic device to operate in an image capturing mode when the orientation of the electronic pen is a first orientation, and

controlling the electronic apparatus to operate in an image capturing and editing mode when the orientation of the electronic pen is a second orientation different from the first orientation.

15. The electronic device of claim 12, further comprising:

a plurality of cameras for capturing a plurality of images,

wherein the instructions, when executed, further configure the at least one processor to: activating at least one camera of the plurality of cameras that corresponds to an orientation of the electronic pen.

Technical Field

The present disclosure relates to an apparatus and method for controlling an operation mode of an electronic device using an electronic pen of the electronic device.

Background

With the development of information communication technology and semiconductor technology, electronic devices capable of processing information have been provided. The electronic device may provide various functions such as voice calls, messages, cameras, electronic payments, and broadcasts.

The electronic device may detect an input corresponding to contact, proximity, or pressure of a user's body (e.g., a finger) through the touch screen. The electronic device may also detect an input corresponding to contact or proximity of an electronic pen capable of performing more accurate input than an input using the body of the user.

The above information is presented merely as background information to facilitate an understanding of the present disclosure. There is no determination, nor assertion, as to whether any of the above can be used as prior art with respect to the present disclosure.

Disclosure of Invention

Solution to the problem

A user of the electronic device may write content (e.g., an image) displayed on the electronic device based on input using the electronic pen or gesture input using the electronic pen instead of key input.

However, in order to perform a function corresponding to the electronic pen, the electronic device requires a complicated manipulation at one end of a portion of the user, thereby deteriorating the convenience of use of the electronic pen by the user. For example, when a user of the electronic device adds a memo to a photographed image, the user may capture the image by executing a camera application. A user of the electronic device may select a captured image by executing the image management application and may select a menu for pen input to add a memo to the captured image through the electronic pen.

Aspects of the present disclosure are to address at least the above problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the present disclosure provides an apparatus and method for increasing usability of an electronic pen in an electronic device.

Additional aspects will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the presented embodiments.

According to an aspect of the present disclosure, an electronic device is provided. The electronic device includes: a housing; a display device exposed through a portion of the housing; a recess disposed inside the housing and extending along a length of the housing; an electronic pen insertable into and removable from the recess; at least one processor located inside the housing and operatively connected to the display device; and a memory operatively connected to the at least one processor. The memory stores instructions that, when executed, configure the at least one processor to: identifying whether the electronic pen is removed from the recess in a low power mode; receiving information related to the electronic pen when the electronic pen is removed from the recess; executing an application based on at least a portion of the information related to the electronic pen.

According to another aspect of the present disclosure, a method of operating an electronic device is provided. The method comprises the following steps: identifying whether an electronic pen is removed from a recess in a low power mode, wherein the electronic pen is insertable into and removable from the recess disposed inside a housing and extending along a length of the housing; receiving information related to the electronic pen when the electronic pen is removed from the recess; and executing an application based on at least a portion of the information related to the electronic pen.

According to another aspect of the present disclosure, an electronic device is provided. The electronic device includes: a housing; a display device exposed through a portion of the housing; a recess disposed inside the housing and extending along a length of the housing; an electronic pen insertable into and removable from the recess; at least one processor located inside the housing and operatively connected to the display device; and a memory operatively connected to the at least one processor. The memory stores instructions that, when executed, configure the at least one processor to: generating content when input through the electronic pen is detected; executing an operational mode of the electronic device related to the content based on the orientation of the electronic pen.

Other aspects, advantages, and salient features of the disclosure will become apparent to those skilled in the art from the following detailed description, which, taken in conjunction with the annexed drawings, discloses various embodiments of the disclosure.

Drawings

The above and other aspects, features and advantages of particular embodiments of the present disclosure will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings in which:

FIG. 1 is a block diagram illustrating an electronic device in a network environment according to an embodiment of the present disclosure;

FIG. 2 is a block diagram illustrating an electronic pen according to an embodiment of the present disclosure;

FIG. 3 is a flow chart illustrating operation of an electronic device to determine an operational mode based on input through an electronic pen according to an embodiment of the present disclosure;

FIG. 4A illustrates a method of performing an operational mode corresponding to an electronic pen based on input through the electronic pen, according to an embodiment of the present disclosure; FIG. 4B illustrates a method of performing an operational mode corresponding to an electronic pen based on input through the electronic pen, according to an embodiment of the present disclosure; FIG. 4C illustrates a method of performing an operational mode corresponding to an electronic pen based on input through the electronic pen, according to an embodiment of the present disclosure;

fig. 5 is a flowchart illustrating an operation of the electronic device selecting an editing application corresponding to the electronic pen according to an embodiment of the present disclosure;

fig. 6 illustrates a screen for displaying an editing application corresponding to an electronic pen according to an embodiment of the present disclosure;

FIG. 7 is a flow chart illustrating operation of an electronic device to drive a camera corresponding to an orientation of an electronic pen according to an embodiment of the disclosure;

FIG. 8 is a flow chart illustrating operation of an electronic device configuring an operational mode corresponding to an orientation of an electronic pen according to an embodiment of the present disclosure;

fig. 9 is a flowchart illustrating an operation of an electronic device to execute an application based on information on an electronic pen according to an embodiment of the present disclosure;

FIG. 10 is a flowchart illustrating operation of an electronic device to execute an application corresponding to an orientation of an electronic pen according to an embodiment of the present disclosure;

fig. 11 is a flowchart illustrating an operation of an electronic apparatus to execute an application based on an input through an electronic pen according to an embodiment of the present disclosure; and

fig. 12 is a flowchart illustrating an operation of an electronic device to execute an application based on a button input by an electronic pen according to an embodiment of the present disclosure.

Throughout the drawings, it should be noted that the same reference numerals are used to describe the same or similar elements, features and structures.

Detailed Description

The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of various embodiments of the disclosure as defined by the claims and their equivalents. It includes various specific details to aid understanding, but these details are to be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the various embodiments described herein can be made without departing from the scope and spirit of the present disclosure. In addition, descriptions of well-known functions and constructions may be omitted for clarity and conciseness.

The terms and words used in the following description and claims are not limited to the written meaning, but are used only by the inventor to enable a clear and consistent understanding of the disclosure. Accordingly, it will be apparent to those skilled in the art that the following descriptions of the various embodiments of the present disclosure are provided for illustration only and not for the purpose of limiting the disclosure as defined by the appended claims and their equivalents.

It should be understood that the singular forms "a," "an," and "the" include plural referents unless the context clearly dictates otherwise. Thus, for example, reference to "a component surface" includes reference to one or more of these surfaces.

Fig. 1 is a block diagram illustrating an electronic device 101 in a network environment 100, in accordance with various embodiments.

Referring to fig. 1, an electronic device 101 in a network environment 100 may communicate with an electronic device 102 via a first network 198 (e.g., a short-range wireless communication network) or with an electronic device 104 or a server 108 via a second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input device 150, a sound output device 155, a display device 160, an audio module 170, a sensor module 176, an interface 177, a connection terminal 178, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a Subscriber Identity Module (SIM)196, or an antenna module 197. In some embodiments, at least one of the components (e.g., display device 160 or camera module 180) may be omitted from electronic device 101, or one or more other components may be added to electronic device 101. In some embodiments, some of the components may be implemented as a single integrated circuit. For example, the sensor module 176 (e.g., a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented to be embedded in the display device 160 (e.g., a display).

The processor 120 may run, for example, software (e.g., the program 140) to control at least one other component (e.g., a hardware component or a software component) of the electronic device 101 connected to the processor 120, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, processor 120 may load commands or data received from another component (e.g., sensor module 176 or communication module 190) into volatile memory 132, process the commands or data stored in volatile memory 132, and store the resulting data in non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a Central Processing Unit (CPU) or an Application Processor (AP)) and an auxiliary processor 123 (e.g., a Graphics Processing Unit (GPU), an Image Signal Processor (ISP), a sensor hub processor, or a Communication Processor (CP)) that is operatively independent of or in conjunction with the main processor 121. Additionally or alternatively, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or be adapted specifically for a specified function. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of the main processor 121.

The secondary processor 123 (rather than the primary processor 121) may control at least some of the functions or states associated with at least one of the components of the electronic device 101 (e.g., the display device 160, the sensor module 176, or the communication module 190) when the primary processor 121 is in an inactive (e.g., sleep) state, or the secondary processor 123 may cooperate with the primary processor 121 to control at least some of the functions or states associated with at least one of the components of the electronic device 101 (e.g., the display device 160, the sensor module 176, or the communication module 190) when the primary processor 121 is in an active state (e.g., running an application). According to an embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., the camera module 180 or the communication module 190) that is functionally related to the auxiliary processor 123.

The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., program 140) and input data or output data for commands associated therewith. The memory 130 may include volatile memory 132 or non-volatile memory 134.

The program 140 may be stored in the memory 130 as software, and the program 140 may include, for example, an Operating System (OS)142, middleware 144, or an application 146.

The input device 150 may receive commands or data from outside of the electronic device 101 (e.g., a user) to be used by other components of the electronic device 101, such as the processor 120. The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (e.g., a stylus pen).

The sound output device 155 may output a sound signal to the outside of the electronic device 101. The sound output device 155 may include, for example, a speaker or a receiver. The speaker may be used for general purposes such as playing multimedia or playing a record and the receiver may be used for incoming calls. Depending on the embodiment, the receiver may be implemented separate from the speaker, or as part of the speaker.

Display device 160 may visually provide information to the exterior of electronic device 101 (e.g., a user). The display device 160 may include, for example, a display, a holographic device, or a projector, and control circuitry for controlling a respective one of the display, holographic device, and projector. According to embodiments, the display device 160 may include touch circuitry adapted to detect a touch or sensor circuitry (e.g., a pressure sensor) adapted to measure the intensity of a force caused by a touch.

The audio module 170 may convert sound into an electrical signal and vice versa. According to embodiments, the audio module 170 may obtain sound via the input device 150 or output sound via the sound output device 155 or a headset of an external electronic device (e.g., the electronic device 102) directly (e.g., wired) connected or wirelessly connected with the electronic device 101.

The sensor module 176 may detect an operating state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., state of a user) external to the electronic device 101 and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyroscope sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an Infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more particular protocols to be used to directly (e.g., wired) or wirelessly connect the electronic device 101 with an external electronic device (e.g., the electronic device 102). According to an embodiment, the interface 177 may include, for example, a high-definition multimedia interface (HDMI), a Universal Serial Bus (USB) interface, a Secure Digital (SD) card interface, or an audio interface.

The connection end 178 may include a connector via which the electronic device 101 may be physically connected with an external electronic device (e.g., the electronic device 102). According to an embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

The haptic module 179 may convert the electrical signal into a mechanical stimulus (e.g., vibration or motion) or an electrical stimulus that may be recognized by the user via his sense of touch or kinesthesia. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

The camera module 180 may capture still images or moving images. According to an embodiment, the camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.

The power management module 188 may manage power to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as at least part of a Power Management Integrated Circuit (PMIC), for example.

The battery 189 may power at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., the electronic device 102, the electronic device 104, or the server 108), and performing communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently of the processor 120 (e.g., an Application Processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a Global Navigation Satellite System (GNSS) communication module) or a wired communication module 194 (e.g., a Local Area Network (LAN) communication module or a Power Line Communication (PLC) module). A respective one of these communication modules may communicate with external electronic devices via a first network 198 (e.g., a short-range communication network such as bluetooth, wireless fidelity (Wi-Fi) direct, or infrared data association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a cellular network, the internet, or a computer network (e.g., a LAN or Wide Area Network (WAN))). These various types of communication modules may be implemented as a single component (e.g., a single chip), or may be implemented as multiple components (e.g., multiple chips) that are separate from one another. The wireless communication module 192 may identify and authenticate the electronic device 101 in a communication network, such as the first network 198 or the second network 199, using subscriber information, such as an International Mobile Subscriber Identity (IMSI), stored in the subscriber identity module 196.

The antenna module 197 may transmit signals or power to or receive signals or power from outside of the electronic device 101 (e.g., an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a radiating element composed of a conductive material or conductive pattern formed in or on a substrate (e.g., a PCB). According to an embodiment, the antenna module 197 may include a plurality of antennas. In this case, at least one antenna suitable for a communication scheme used in a communication network, such as the first network 198 or the second network 199, may be selected from the plurality of antennas by, for example, the communication module 190 (e.g., the wireless communication module 192). Signals or power may then be transmitted or received between the communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, additional components other than the radiating element, such as a Radio Frequency Integrated Circuit (RFIC), may be additionally formed as part of the antenna module 197.

At least some of the above components may be interconnected and communicate signals (e.g., commands or data) communicatively between them via an inter-peripheral communication scheme (e.g., bus, General Purpose Input Output (GPIO), Serial Peripheral Interface (SPI), or Mobile Industry Processor Interface (MIPI)).

According to an embodiment, commands or data may be sent or received between the electronic device 101 and the external electronic device 104 via the server 108 connected with the second network 199. Each of the electronic device 102 and the electronic device 104 may be the same type of device as the electronic device 101 or a different type of device from the electronic device 101. According to embodiments, all or some of the operations to be performed at the electronic device 101 may be performed at one or more of the external electronic device 102, the external electronic device 104, or the server 108. For example, if the electronic device 101 should automatically perform a function or service or should perform a function or service in response to a request from a user or another device, the electronic device 101 may request the one or more external electronic devices to perform at least part of the function or service instead of or in addition to performing the function or service. The one or more external electronic devices that received the request may perform the requested at least part of the functions or services or perform another function or another service related to the request and transmit the result of the execution to the electronic device 101. The electronic device 101 may provide the result as at least a partial reply to the request with or without further processing of the result. To this end, for example, cloud computing technology, distributed computing technology, or client-server computing technology may be used.

The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may comprise, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. According to the embodiments of the present disclosure, the electronic devices are not limited to those described above.

It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalents, or alternatives to the respective embodiments. For the description of the figures, like reference numerals may be used to refer to like or related elements. It will be understood that a noun in the singular corresponding to a term may include one or more things unless the relevant context clearly dictates otherwise. As used herein, each of the phrases such as "a or B," "at least one of a and B," "at least one of a or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B or C" may include any or all possible combinations of the items listed together with the respective one of the plurality of phrases. As used herein, terms such as "1 st" and "2 nd" or "first" and "second" may be used to distinguish one element from another element simply and not to limit the elements in other respects (e.g., importance or order). It will be understood that, if an element (e.g., a first element) is referred to as being "coupled to", "connected to" or "connected to" another element (e.g., a second element), it can be directly (e.g., wiredly) connected to, wirelessly connected to, or connected to the other element via a third element, when the term "operatively" or "communicatively" is used or not.

As used herein, the term "module" may include units implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuitry"). A module may be a single integrated component adapted to perform one or more functions or a minimal unit or portion of the single integrated component. For example, according to an embodiment, the modules may be implemented in the form of Application Specific Integrated Circuits (ASICs).

The various embodiments set forth herein may be implemented as software (e.g., program 140) comprising one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that is readable by a machine (e.g., electronic device 101). For example, under control of a processor, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) may invoke and execute at least one of the one or more instructions stored in the storage medium, with or without the use of one or more other components. This enables the machine to be operable to perform at least one function in accordance with the invoked at least one instruction. The one or more instructions may include code generated by a compiler or code capable of being executed by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Where the term "non-transitory" simply means that the storage medium is a tangible device and does not include a signal (e.g., an electromagnetic wave), the term does not distinguish between data being semi-permanently stored in the storage medium and data being temporarily stored in the storage medium.

According to embodiments, methods according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be used as a product for conducting a transaction between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium, such as a compact disc read only memory (CD-ROM), or may be distributed (e.g., downloaded or uploaded) online via an application store (e.g., a Play store), or may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smartphones). At least part of the computer program product may be temporarily generated if it is published online, or at least part of the computer program product may be at least temporarily stored in a machine readable storage medium, such as a memory of a manufacturer's server, a server of an application store, or a forwarding server.

According to various embodiments, each of the above components (e.g., modules or programs) may comprise a single entity or multiple entities. According to various embodiments, one or more of the above-described components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., modules or programs) may be integrated into a single component. In such a case, according to various embodiments, the integrated component may still perform one or more functions of each of the plurality of components in the same or similar manner as the corresponding one of the plurality of components performed the one or more functions prior to integration. Operations performed by a module, program, or another component may be performed sequentially, in parallel, repeatedly, or in a heuristic manner, or one or more of the operations may be performed in a different order or omitted, or one or more other operations may be added, in accordance with various embodiments.

According to an embodiment, the input device 150 may comprise an electronic pen. For example, when the electronic pen contacts or hovers over a touch panel (e.g., display device 160) of the electronic device 101, the electronic pen may resonate with an electromagnetic field periodically formed on the touch panel to generate a resonant signal.

According to an embodiment, the processor 120 may execute a mode for using the electronic pen when receiving the execution input through the electronic pen. For example, when an input of an electronic pen corresponding to a photographing button is received, the processor 120 may acquire an image through the camera module 180. The processor 120 may switch the operating mode of the electronic device 101 to a mode using an electronic pen associated with the image acquired by the camera module 180. When input related to an image is received by the electronic pen, the processor 120 may combine the image with the input by the electronic pen and store it in the memory 130.

According to an embodiment, the processor 120 may selectively drive the camera module 180 based on the orientation of the electronic pen. For example, when executing the camera mode, the processor 120 may identify whether there is an electronic pen functionally connected to the electronic device 101. When there is an electronic pen functionally connected to the electronic device 101, the processor 120 may activate a camera corresponding to the orientation of the electronic pen among a plurality of cameras (e.g., a front camera and a rear camera) included in the camera module 180. For example, the front camera may be driven when the orientation of the electronic pen matches the orientation of the electronic device. For example, the rear camera may be driven when the orientation of the electronic pen is different from the orientation of the electronic device. For example, the orientation of the electronic pen may be the orientation of the pen tip of the electronic pen, and may be determined based on sensed data of a 6-axis sensor included in the electronic pen. For example, the orientation of the electronic device may be the orientation of the display device 160 (e.g., a viewfinder) of the electronic device and may be determined based on sensed data from the sensor module 176 (e.g., a 6-axis sensor).

According to an embodiment, the processor 120 may correct the orientation of the electronic pen such that the orientation of the electronic device 101 matches the orientation of the electronic pen. For example, the orientation of the electronic device 101 and the orientation of the electronic pen may be acquired by a 6-axis sensor. The processor 120 may correct the orientation of the electronic pen provided from the electronic pen to match the electronic device 101 based on the orientation (e.g., z-axis value) of the electronic pen inserted into the electronic device 101. For example, when the electronic pen is inserted forward into the electronic device 101, it may be determined that the z-axis values of the electronic pen and the electronic device match each other. For example, when the electronic pen is inserted backwards into the electronic device 101, the processor 120 may determine that the z-axis values of the electronic pen and the electronic device are opposite to each other. In this case, the processor 120 may correct the orientation of the electronic pen provided from the electronic pen to match the electronic device 101.

According to an embodiment, the processor 120 may determine the operation mode of the electronic device 101 based on the orientation of the electronic pen. For example, when an input corresponding to a photographic event is received, the processor 120 may identify an orientation of an electronic pen functionally connected to the electronic device 101. When the electronic pen has a first orientation (e.g., an upward direction), the processor 120 may operate in an image capture mode. For example, the processor 120 may store images acquired by the camera module 180 based on the generation of a photographic event. For example, when the electronic pen has a second orientation (e.g., a downward direction), the processor 120 may operate in an image capture and editing mode. For example, the processor 120 may acquire an image through the camera module 180 based on the generation of a photographing event and perform a mode using the electronic pen with respect to the image. The processor 120 may combine the image acquired through the camera module 180 and the input through the electronic pen into one image and store it in the memory 130.

According to an embodiment, when the electronic pen is removed from the electronic device 101 in the low power mode, the processor 120 may execute the application 146 corresponding to the information related to the electronic pen. The information related to the electronic pen may include at least one of: whether a hovering input by the electronic pen is detected, a point in time at which the hovering input is detected, an orientation of the electronic pen, a button input made by the electronic pen. For example, the low power mode may include an inactive state of at least one module (e.g., display device 160) included in electronic device 101 to reduce the amount of power consumed by electronic device 101. For example, the low power mode may include an inactive (or off) state of a display of the electronic device 101 and/or a locked state of the electronic device 101.

For example, when the electronic pen is removed from the electronic device 101 in the low power mode, the processor 120 may identify the orientation of the electronic pen and execute an application related to the determined orientation of the electronic pen. The processor 120 may execute a camera application related to the first orientation of the electronic pen when the orientation of the electronic pen is maintained in the first orientation (e.g., upward direction) for a first predetermined time. The processor 120 may execute a memo application related to the second orientation of the electronic pen when the orientation of the electronic pen is maintained in the second orientation (e.g., downward direction) for a first predetermined time.

For example, when the electronic pen is removed from the electronic device 101 in the low power mode, the processor 120 may execute a camera application or a memo application based on a state of an application execution menu and/or a button input made through the electronic pen. When the application execution menu is active, the processor 120 may automatically execute the memo application in response to the removal of the electronic pen. For example, when the application execution menu is in an active state, the processor 120 may execute the memo application while maintaining the locked state of the electronic apparatus 101 in response to the removal of the electronic pen. For example, after activating the display while maintaining the locked state, the processor 120 may display a screen related to the execution of the memo application. The memo application executed in the locked state of the electronic apparatus 101 may be a memo application configured to be executed in the low power mode. The memo application executed in the locked state of the electronic apparatus 101 may include at least a portion of the memo application executed in the normal mode of the electronic apparatus 101 or may be classified as a separate application. When the application execution menu is in an inactive state, the processor 120 may determine whether an input using a button of the electronic pen located (or disposed) within the hovering area or a first input (e.g., a long input) using a button of the electronic pen located outside the hovering area is detected. For example, the hovering area may be an area where the electronic apparatus 101 can detect hovering input by the electronic pen, and may have a range where the electronic apparatus 101 can recognize an electromagnetic field having a reference size or more with respect to the electronic pen. The processor 120 may execute the memo application when detecting an input (e.g., a single press, a double press, or a long press) of a button of the electronic pen located within the hovering area. For example, the processor 120 may execute a memo application while maintaining a locked state of the electronic apparatus 101 in response to an input of a button of an electronic pen located within the hovering area. For example, after activating the display while maintaining the locked state, the processor 120 may display a screen related to the execution of the memo application. The processor 120 may execute the camera application when a first input (e.g., a long input) of a button of the electronic pen located outside the hovering area is detected. For example, the processor 120 may execute a camera application while maintaining a locked state of the electronic apparatus 101 in response to a first input of a button of the electronic pen located outside the hovering area. For example, after activating the display while maintaining the locked state, the processor 120 may display a screen related to the execution of the camera application. The camera application executed in the locked state of the electronic apparatus 101 may be a camera application configured to be executed in the low power mode. The camera application executed in the locked state of the electronic apparatus 101 may include at least a portion of the camera application executed in the normal mode of the electronic apparatus 101 or may be classified as a separate application. When a first input of a button of the electronic pen located outside the hovering area is detected while the memo application is executed in the locked state, the processor 120 may switch the memo application execution mode to the camera application execution mode while maintaining the locked state. When the memo application execution mode is switched to the camera application execution mode, the processor 120 may terminate the memo application. For example, a single press may include: there is a button input that detects a pressing and releasing of a button of the electronic pen within a first reference time. For example, a double press may include: there is a button input in which the pressing and releasing of the button of the electronic pen is detected twice consecutively within a second reference time. The long press may include: there is a button input that detects a press of a button of the electronic pen within a third reference time. The first reference time may be the same as or different from the second reference time and/or the third reference time. The second reference time may be the same as or different from the third reference time.

According to an embodiment, when no input is received within a second predetermined time while providing a service using the electronic pen, or when no input is received within a second predetermined time after removing the electronic pen from the electronic apparatus 101, the processor 120 may switch to the low power mode and control the display (e.g., the display apparatus 160) to be deactivated. When an input (e.g., a single press, a double press, or a long press) of a button of the electronic pen located within the hovering area is detected in the low power mode, the processor 120 may execute the memo application. For example, the processor 120 may execute a memo application while maintaining the locked state of the electronic device 101. When a first input (e.g., a long press) of a button of the electronic pen located outside the hovering area is detected in the low power mode, the processor 120 may execute a camera application. For example, the processor 120 may unlock the locked state of the electronic device 101 and execute a camera application. Unlocking the locked state of the electronic device 101 may indicate operation of the electronic device 101 in the normal mode. When a second input (e.g., a single press or a double press) of a button of the electronic pen located outside the hovering area is detected in the low power mode, the processor 120 may switch the operation mode of the electronic apparatus 101 to the normal mode by unlocking the locked state of the electronic apparatus 101. For example, display device 160 may display a screen displayed just before electronic device 101 switches to the low power mode based on the unlocking of the locked state of electronic device 101. The second predetermined time may be the same as or different from the first predetermined time.

According to an embodiment, the electronic device 101 may comprise a housing. For example, the housing may include: a first surface (e.g., a front surface or an upper surface) in a first direction (e.g., + z-axis direction) of the electronic device 101; a second surface (e.g., a rear surface or a lower surface) in a direction opposite to the first surface; and a side surface disposed to surround at least a portion of the first surface and the second surface. For example, the display device 160 may be configured to be exposed to the outside through a portion of the housing.

Fig. 2 is a block diagram illustrating an electronic pen according to an embodiment of the present disclosure.

Referring to fig. 2, the electronic pen 200 may include at least one of a resonance module 210, a switch module 220, a charging module 230, a battery 240, a communication module 250, or a sensor module 260.

According to an embodiment, the resonance module 210 may resonate with an electromagnetic field formed by an electronic device (e.g., the electronic device 101 of fig. 1) and generate a resonance signal. For example, when the electronic pen 200 contacts a touch panel of the electronic device 101, the resonance module 210 may resonate with an electromagnetic field periodically formed on the touch panel and generate a resonance signal. For example, when the electronic pen 200 is stored in a storage space of the electronic device 101, the resonance module 210 may resonate with an electromagnetic field periodically formed by a detection sensor included in the storage space and generate a resonance signal. For example, the resonance module 210 may further include a variable capacitor whose capacitance varies according to the pen pressure of the electronic pen 200. For example, the storage space may be configured in the form of a recess extending a long length based on the shape of the electronic pen 200 within the housing of the electronic device 101.

According to an embodiment, the switching module 220 may connect the resonance module 210 to the charging module 230 or isolate the resonance module 210 from the charging module 230. For example, the switching module 220 may selectively connect the resonance module 210 and the charging module 230 based on the strength of the resonance signal generated by the resonance module 210.

According to an embodiment, when the charging module 230 is connected to the resonance module 210 through the switching module 220, the charging module 230 may rectify a resonance signal generated by the resonance module 210 into a direct current signal and provide the direct current signal to the battery 240.

According to an embodiment, the battery 240 may provide power for driving the communication module 250 and the sensor module 260. For example, the battery 240 may be charged using a direct current signal (direct current power) provided from the charging module 230. The battery 240 may include a super capacitor.

According to an embodiment, the communication module 250 may transmit the state information and the input information of the electronic pen 200 to an external device (e.g., the electronic device 101) through a short-range communication scheme. For example, when an input corresponding to a button (not shown) of the electronic pen 200 is received, the communication module 250 may transmit button input information to the electronic device 101. For example, the communication module 250 may transmit orientation information of the electronic pen 200 (e.g., sensing data of a 6-axis sensor) or remaining capacity information of the battery 240 acquired through the sensor module 260 to the electronic device 101. For example, the short-range communication scheme may include at least one of bluetooth, Bluetooth Low Energy (BLE), and WLAN.

According to an embodiment, the sensor module 260 may generate an electrical signal or data value corresponding to an internal state or an external environmental state of operation of the electronic pen 200. For example, the sensor module 260 may include at least one of a 6-axis sensor, a battery remaining capacity detection sensor, and a pressure sensor.

According to various embodiments of the present disclosure, an electronic device (e.g., electronic device 101 of fig. 1) includes: a housing; a display device (e.g., display device 160 of fig. 1) exposed through a portion of the housing; a recess disposed inside the housing and extending a long length; an electronic pen (e.g., electronic pen 200 of fig. 2) removably inserted into the recess; a processor (e.g., processor 120 of fig. 1) located inside the housing and operatively connected to the display device; and a memory (e.g., memory 130 of fig. 1) operatively connected to the processor, wherein the memory stores instructions that, when executed, cause the processor to: identifying whether the electronic pen is removed from the recess in the low power mode; receiving information related to the electronic pen when the electronic pen is removed from the recess; and executing the application based on at least a portion of the information related to the electronic pen.

According to various embodiments, the information relating to the electronic pen comprises at least one of: whether a hovering input by the electronic pen is detected, a time point at which the hovering input is detected, an orientation of the electronic pen, input information of a button included in the electronic pen.

According to various embodiments, the housing may further include a wireless communication circuit (e.g., the communication module 190 of fig. 1), and the instructions may receive at least one of an orientation of the electronic pen and input information of a button included in the electronic pen from the electronic pen through short-range wireless communication using the wireless communication circuit.

According to various embodiments, the short-range wireless communication may include at least one of bluetooth and Bluetooth Low Energy (BLE).

According to various embodiments, the instruction may acquire input information of a button included in the electronic pen, execute the memo application when the input information of the button included in the electronic pen satisfies a first predetermined condition, and execute the camera application when the input information of the button included in the electronic pen satisfies a second predetermined condition.

According to various embodiments, the first predetermined condition may comprise a condition relating to input of a button of the electronic pen located within the hovering area, and the second predetermined condition may comprise a condition relating to input of a button of the electronic pen located outside the hovering area.

According to various embodiments, the instructions may identify an orientation of the electronic pen, execute the camera application when the orientation of the electronic pen is maintained in a first orientation for a predetermined time, and execute the memo application when the orientation of the electronic pen is maintained in a second orientation for the first predetermined time.

According to various embodiments, the instructions may identify the orientation of the electronic pen based on sensing data of a 6-axis sensor included in the electronic pen received from the electronic pen through short-range wireless communication.

According to another aspect of the present disclosure, an electronic device (e.g., electronic device 101 of fig. 1) includes: a housing; a display device (e.g., display device 160 of fig. 1) exposed through a portion of the housing; a recess disposed inside the housing and extending a long length; an electronic pen (e.g., electronic pen 200 of fig. 2) removably inserted into the recess; a processor (e.g., processor 120 of fig. 1) located inside the housing and operatively connected to the display device; and a memory (e.g., memory 130 of fig. 1) operatively connected to the processor, wherein the memory stores instructions that, when executed, cause the processor to: content is generated when an input through the electronic pen is detected, and an operation mode of the electronic apparatus related to the content is performed based on an orientation of the electronic pen.

According to various embodiments, the housing may further include a wireless communication circuit (e.g., the communication module 190 of fig. 1), and the instructions may identify the orientation of the electronic pen based on sensed data of a 6-axis sensor included in the electronic pen received from the electronic pen through short-range wireless communication using the wireless communication circuit.

According to various embodiments, the instructions may cause the electronic device to operate in an image capture mode when the orientation of the electronic pen is a first orientation, and the instructions may cause the electronic device to operate in an image capture and editing mode when the orientation of the electronic pen is a second orientation different from the first orientation.

According to various embodiments, the electronic device may further include a plurality of cameras (e.g., camera module 180 of fig. 1), and the instructions may activate at least one camera of the plurality of cameras that corresponds to the orientation of the electronic pen.

Fig. 3 is a flow chart 300 illustrating operation of an electronic device to determine an operational mode based on input through an electronic pen according to an embodiment of the present disclosure.

FIG. 4A is a diagram 400 illustrating a method of performing an operation mode corresponding to an electronic pen based on input through the electronic pen, according to an embodiment of the present disclosure; FIG. 4B is a diagram 410 illustrating a method of performing an operation mode corresponding to an electronic pen based on input through the electronic pen, according to an embodiment of the present disclosure; fig. 4C is a diagram 420 illustrating a method of performing an operation mode corresponding to an electronic pen based on an input through the electronic pen, according to an embodiment of the present disclosure.

Hereinafter, the electronic device may include the electronic device 101 of fig. 1 or at least a portion of the electronic device 101 (e.g., the processor 120). The electronic pen may comprise the electronic pen 200 of fig. 2 or at least a part of the electronic pen 200.

Referring to fig. 3, the electronic device 101 may detect an input through the electronic pen 200 related to the generation of content (e.g., images, moving images, or audio data) in operation 301. For example, processor 120 may output an image (e.g., preview image 401) acquired by camera module 180 to display device 160, as shown in fig. 4A. The processor 120 may detect an input through the electronic pen 200 corresponding to a photographing button 403 for image capture included in the user interface. For example, the processor 120 may record an audio signal (e.g., a speech signal) captured by a microphone (e.g., the input device 150), as shown in fig. 4B. The processor 120 may detect an input through the electronic pen 200 corresponding to a recording end button 413 for a recording service included in the user interface 411 while recording an audio signal. For example, the processor 120 may capture a dynamic image 421 through the camera module 180, as shown in fig. 4C. The processor 120 may detect an input through the electronic pen 200 corresponding to a moving image capturing termination button (or photographing end button) 423 for moving image capturing included in the user interface.

In operation 303, the electronic device may determine an operation mode of the electronic device 101 related to the electronic pen 200 based on an input through the electronic pen 200 and information about an application (e.g., the application 146 of fig. 1) executed by the electronic device 101. The electronic apparatus 101 may determine a mode for editing content (e.g., an image, a recorded file, or a moving image file) acquired through the application 146 executed by the electronic apparatus 101 using the electronic pen 200. For example, when an input through the electronic pen 200 corresponding to the photographing button 403 is detected as illustrated in fig. 4A, the processor 120 may select an operation mode of the electronic apparatus 101 as an image capturing and editing mode. For example, the image capturing and editing modes may include an operation mode for acquiring an image through the camera module 180 and editing the image through the electronic pen 200. For example, when an input through the electronic pen 200 corresponding to the recording end button 413 is detected as shown in fig. 4B, the processor 120 may select a writing mode as an operation mode of the electronic apparatus 101. For example, the writing mode may include an operation mode for adding additional information to the recording file through the electronic pen 200. For example, when an input through the electronic pen 200 corresponding to the moving image capturing termination button (or photographing end button) 423 is detected as shown in fig. 4C, the processor 120 may select a moving image editing mode as an operation mode of the electronic apparatus 101. For example, the moving image editing mode may include an operation mode for adding additional information to a moving image file recorded by the electronic apparatus 101 through the electronic pen 200.

In operation 305, the electronic device 101 may execute an operation mode of the electronic device 101 with respect to the electronic pen 200. For example, when an input through the electronic pen 200 corresponding to the photographing button 403 is detected as shown in fig. 4A, the processor 120 may capture an image through the camera module 180 and switch to the editing mode. When an input through the electronic pen 200 is received in the editing mode, the processor 120 may display information 405 corresponding to the input through the electronic pen 200 such that it overlaps at least a portion of the image. When the edit mode is ended, the processor 120 may store information 405 corresponding to an input through the electronic pen 200 and the captured image as one image. For example, one image may be generated separately from the captured image, or the captured image may be updated to the one image. For example, when an input by the electronic pen 200 corresponding to the recording end button 413 is detected as shown in fig. 4B, the processor 120 may switch to a writing mode corresponding to the recording file. The processor 120 may store information input through the electronic pen 200 in the writing mode as additional information 415 related to the recording file. For example, when displaying information related to a recording file, the display device 160 may display an icon 417 indicating that there is additional information related to the recording file. For example, when an input through the electronic pen 200 corresponding to the moving image capture termination button 423 is detected as shown in fig. 4C, the processor 120 may switch to an editing mode corresponding to a moving image file. For example, the processor 120 may capture an image at a point of time when an input through the electronic pen 200 is detected, and perform an editing mode. The processor 120 may store information (e.g., information 425) input through the electronic pen 200 in the editing mode as additional information related to the moving image file. For example, when a moving image file is displayed, the display device 160 may display an icon 427 indicating that additional information exists in at least a portion (e.g., thumbnail) of the moving image file.

Fig. 5 is a flowchart 500 illustrating an operation of the electronic device to select an editing application corresponding to the electronic pen according to an embodiment of the present disclosure.

Fig. 6 illustrates a screen 600 for displaying an editing application corresponding to an electronic pen according to an embodiment of the present disclosure.

The following description may be the following operations: in operations 303 through 305, an operation mode of an electronic device related to the electronic pen 200 is performed based on an input through the electronic pen (e.g., the electronic pen 200 of fig. 2). Hereinafter, the electronic device may include the electronic device 101 of fig. 1 or at least a portion of the electronic device 101 (e.g., the processor 120).

Referring to fig. 5, in operation 501, when an input through the electronic pen 200 is received (e.g., in operation 301 of fig. 3), the electronic apparatus 101 may capture an image through a camera (e.g., the camera module 180). For example, the processor 120 may detect an input through the electronic pen 200 corresponding to the photographing button 403 in a state in which the preview image 401 is displayed, as shown in fig. 6. The processor 120 may capture an image through the camera module 180 at a point of time when an input through the electronic pen 200 corresponding to the photographing button 403 is detected.

In operation 503, the electronic apparatus 101 may display information on at least one editing application capable of editing the captured image by the electronic pen 200. For example, the processor 120 may display an image captured using the camera module 180 on the display device 160. Display device 160 may display an icon 605 in a portion of the captured image corresponding to an editing application that may be used to edit the captured image, as shown in fig. 6.

In operation 505, the electronic apparatus 101 may recognize whether an editing application for editing the captured image is selected using the electronic pen 200. For example, the processor 120 may recognize whether an input corresponding to at least one icon corresponding to an editing application displayed on the display device 160 among the icons 605 is received, as shown in fig. 6.

When the editing application is not selected (e.g., no in operation 505), the electronic apparatus 101 may display information on at least one editing application program capable of editing the captured image by the electronic pen 200 in operation 503. For example, the processor 120 may terminate the editing mode of the captured image when no input is received within a third predetermined time from a time point at which information about the editing application is displayed. The display device 160 may display a preview image acquired through the camera module 180.

When the editing application is selected (yes in operation 505), the electronic apparatus 101 may execute the selected editing application and edit the captured image through the electronic pen 200 in operation 507. For example, the processor 120 may attach the captured image to a user interface of an editing application and execute an editing mode (e.g., a handwriting mode). The processor 120 may display information corresponding to an input through the electronic pen 200 such that it overlaps at least a portion of the captured image.

Fig. 7 is a flowchart 700 illustrating an operation of an electronic device driving a camera corresponding to an orientation of an electronic pen, according to an embodiment of the present disclosure.

The following description may be an operation for detecting an input by an electronic pen (e.g., the electronic pen 200 of fig. 2) in operation 301 of fig. 3. Hereinafter, the electronic device may include the electronic device 101 of fig. 1 or at least a portion of the electronic device 101 (e.g., the processor 120).

Referring to fig. 7, in operation 701, the electronic device 101 may detect generation of an event for driving a camera (e.g., the camera module 180 of fig. 1). For example, the processor 120 may receive an input (e.g., a touch input) corresponding to an icon related to a camera application through the input device 150.

When an event for driving the camera (the camera module 180) is generated, the electronic device 101 may recognize the orientation of the electronic pen 200 in operation 703. For example, the processor 120 may receive orientation information of the electronic pen 200 from the electronic pen 200 through the communication module 190. For example, the orientation information of the electronic pen 200 is sensing data of a 6-axis sensor (e.g., the sensor module 260 of fig. 2) of the electronic pen 200, and may be received from the electronic pen 200 in response to a request from the electronic device 101.

In operation 705, the electronic device 101 may activate a camera (camera module 180) corresponding to an orientation of the electronic pen 200 among the plurality of cameras 180. For example, when the orientation of the electronic pen 200 is the same as the orientation of the electronic device 101, the processor 120 may determine that the electronic pen 200 is facing the user. In this case, the processor 120 may activate the first camera (front camera) located in the direction in which the electronic device 101 is facing. For example, when the orientation of the electronic pen 200 is opposite to the orientation of the electronic device 101, the processor 120 may determine that the electronic pen 200 is facing an object. In this case, the processor 120 may activate a second camera (rear camera) located in an orientation opposite to the orientation of the electronic device 101. For example, the orientation of the electronic pen 200 may include an orientation of a tip (not shown) of the electronic pen 200, and the orientation of the electronic device 101 may include an orientation of a display device 160 (e.g., a viewfinder) of the electronic device 101.

In operation 707, the electronic device 101 may output a preview image acquired by the activated camera (camera module 180) through the display device 160. For example, when it is determined that the electronic pen 200 is oriented to face the user, the processor 120 may control the display device 160 to display a preview image acquired through a front camera. For example, when it is determined that the electronic pen 200 is oriented to face an object located in a direction opposite to the user, the processor 120 may control the display device 160 to display a preview image acquired by a rear camera.

In operation 709, the electronic device 101 may recognize whether the orientation of the electronic pen 200 is changed. For example, the processor 120 may identify whether the orientation of the electronic pen 200 is changed based on sensing data of a 6-axis sensor (e.g., the sensor module 260 of fig. 2) received from the electronic pen 200. For example, the sensing data of the 6-axis sensor acquired from the electronic pen 200 may be periodically transmitted, or may be transmitted to the electronic device 101 at a point of time when a change thereof is detected.

When the orientation of the electronic pen 200 is maintained (e.g., no in operation 709), the electronic apparatus 101 may recognize whether an input through the electronic pen 200 is detected in operation 711. For example, the processor 120 may recognize whether an input through the electronic pen 200 related to the generation of the content is received through the input device 150, as shown in fig. 4A to 4C.

When the input through the electronic pen 200 is not detected (e.g., no in operation 711), the electronic apparatus 101 may recognize the change in the orientation of the electronic pen 200 in operation 709.

When the orientation of the electronic pen 200 is changed (e.g., yes in operation 709), the electronic device 101 may switch the activated camera (camera module 180) of the electronic device 101 based on the changed orientation of the electronic pen 200 in operation 713. For example, when the orientation of the electronic pen 200 is changed to an orientation opposite to the orientation of the electronic device 101, the processor 120 may activate a second camera (rear camera) located in a direction opposite to the direction in which the electronic device 101 is oriented. For example, a first camera (front camera) located in a direction in which the electronic device 101 is oriented may be disabled.

FIG. 8 is a flowchart 800 illustrating operation of an electronic device configuring an operational mode corresponding to an orientation of an electronic pen, according to an embodiment of the present disclosure.

The following description may be an operation for determining an operation mode of the electronic pen 200 based on an input made through the electronic pen (e.g., the electronic pen 200 of fig. 2) in operations 301 to 303 of fig. 3. Hereinafter, the electronic device may include the electronic device 101 of fig. 1 or at least a portion of the electronic device 101 (e.g., the processor 120).

Referring to fig. 8, in operation 801, the electronic apparatus 101 may recognize whether an input through the electronic pen 200 related to the generation of content is detected. For example, the processor 120 may recognize whether an input (e.g., a capture input) through the electronic pen 200 corresponding to an icon (e.g., the photographing button 403 of fig. 4A) regarding the generation of the multimedia content is received through the input device 150. For example, the processor 120 may recognize whether button input information of the electronic pen 200 is received through the communication module 190.

When an input through the electronic pen 200 is detected (e.g., yes in operation 801), the electronic apparatus 101 may recognize the orientation of the electronic pen 200 in operation 803. The orientation of the electronic pen 200 may be recognized based on sensing data (e.g., motion information of the electronic pen 200) of a 6-axis sensor (e.g., the sensor module 260 of fig. 2) included in the electronic pen 200 received from the electronic pen 200. For example, in response to a request from the electronic device 101, sensing data of a 6-axis sensor included in the electronic pen 200 may be received from the electronic pen 200.

In operation 805, the electronic device 101 may identify whether the orientation of the electronic pen 200 corresponds to a first orientation. For example, the first orientation may include a + z-axis direction corresponding to the sky among the 6 axis directions.

When the electronic pen 200 is oriented in the first orientation (e.g., "yes" in operation 805), the electronic apparatus 101 may configure the capture mode to an operational mode of the electronic apparatus 101 in operation 807. When the tip of the electronic pen 200 is in the + z-axis direction facing the sky, the processor 120 may capture an image through the camera module 180 and then determine that no additional input is made through the electronic pen 200. Accordingly, the processor 120 may configure a capture mode for capturing images by the camera module 180 as an operation mode of the electronic device 101.

When the electronic pen 200 is oriented in the second orientation (e.g., no in operation 805), the electronic device 101 may configure an image capture and editing mode of the electronic pen 200 as an operational mode of the electronic device 101 in operation 809. For example, when the tip of the electronic pen 200 is in the-z-axis direction facing the ground, the processor 120 may capture an image through the camera module 180 and then determine that additional input through the electronic pen 200 is generated. Thus, the processor 120 may be configured in an operational mode of the electronic device 101 as an image capturing and editing mode for capturing an image by the electronic pen 200 and editing the captured image.

Fig. 9 is a flowchart 900 illustrating an operation of an electronic device to execute an application based on information on an electronic pen according to an embodiment of the present disclosure.

Hereinafter, the electronic device may include the electronic device 101 of fig. 1 or at least a portion of the electronic device 101 (e.g., the processor 120). The electronic pen may comprise the electronic pen 200 of fig. 2 or at least a part of the electronic pen 200.

Referring to fig. 9, in operation 901, the electronic device 101 may be driven in a low power mode. The low power mode may include an inactive state of at least one module included in the electronic device 101 to reduce the amount of power consumed by the electronic device 101. For example, the processor 120 and the display device 160 may be disabled in the low power mode.

In operation 903, the electronic device 101 may identify whether the electronic pen 200 has been removed. For example, the processor 120 may identify whether the electronic pen 200 is removed from a memory space of the electronic device 101.

When the electronic pen 200 is stored in the storage space (e.g., no in operation 903), the electronic device 101 may remain in the low power mode in operation 901.

When the electronic pen 200 is removed from the storage space (e.g., yes in operation 903), the electronic apparatus 101 may execute the application 146 based on the information about the electronic pen 200 in operation 905. For example, the information related to the electronic pen 200 may include at least one of: whether a hovering input through the electronic pen 200 is detected, a point of time at which the hovering input is detected, an orientation of the electronic pen 200, input information of buttons included in the electronic pen 200. For example, the processor 120 may execute the camera application when the electronic pen 200 is maintained in the first orientation (+ z-axis direction) for a first predetermined time. For example, the processor 120 may execute a memo application when detecting an input of a button of the electronic pen 200 located within the hovering area. For example, the processor 120 may execute a camera application when detecting a first input of a button of the electronic pen 200 located outside the hovering area.

Fig. 10 is a flowchart 1000 illustrating an operation of an electronic device to execute an application corresponding to an orientation of an electronic pen according to an embodiment of the present disclosure.

The following description may be an operation for executing an application (e.g., the application 146 of fig. 1) based on information related to an electronic pen (e.g., the electronic pen 200 of fig. 2) in operation 905 of fig. 9. Hereinafter, the electronic device may include the electronic device 101 of fig. 1 or at least a portion of the electronic device 101 (e.g., the processor 120).

Referring to fig. 10, when the electronic pen 200 is removed (e.g., yes in operation 903 of fig. 9), the electronic device 101 may recognize the orientation of the electronic pen 200 in operation 1001. For example, the processor 120 may receive the orientation information (sensed data of the 6-axis sensor) of the electronic pen 200 from the electronic pen 200 through the communication module 190. For example, the orientation information of the electronic pen 200 may be received from the electronic pen 200 in response to a request from the electronic device 101. For example, when it is detected that the electronic pen 200 is removed from the electronic device 101, the electronic pen 200 may periodically transmit sensing data of a 6-axis sensor (e.g., the sensing module or the sensor module 260 of fig. 2) to the electronic device 101.

In operation 1003, the electronic device 101 may recognize whether the orientation of the electronic pen 200 corresponds to the first orientation. For example, the processor 120 may identify whether the orientation of the pen tip of the electronic pen 200 is a first orientation facing the sky, based on the orientation information of the electronic pen 200 received from the electronic pen 200.

When the orientation of the electronic pen 200 corresponds to a first orientation (e.g., "yes" in operation 1003), the electronic device 101 may execute a camera application in operation 1005. For example, when the tip of the electronic pen 200 continuously faces the sky (first orientation) within a first predetermined time, the processor 120 may determine that no writing input through the electronic pen 200 is generated, and may execute a camera application. For example, when executing a camera application, the processor 120 may activate a front camera of the electronic device 101 and operate in a self-portrait mode. For example, the display device 160 may display an image (preview image) acquired by the camera module 180 on a lock screen (e.g., on a higher display layer).

When the orientation of the electronic pen 200 corresponds to a second orientation (e.g., -z-axis direction) (e.g., "no" in operation 1003), the electronic apparatus 101 may execute a memo application in operation 1007. For example, when the tip of the electronic pen 200 continuously faces the ground (second orientation) for a first predetermined time, the processor 120 may determine that writing input by the electronic pen 200 is generated and execute a memo application. For example, the display device 160 may display an execution screen of a memo application on a lock screen (e.g., on a higher display layer).

Fig. 11 is a flowchart 1100 illustrating an operation of an electronic device to execute an application based on an input through an electronic pen according to an embodiment of the present disclosure.

The following description may be an operation for executing an application (e.g., the application 146 of fig. 1) based on information related to an electronic pen (e.g., the electronic pen 200 of fig. 2) in operation 905 of fig. 9. Hereinafter, the electronic device may include the electronic device 101 of fig. 1 or at least a portion of the electronic device 101 (e.g., the processor 120).

Referring to fig. 11, when the electronic pen 200 is removed (e.g., yes in operation 903 of fig. 3), the electronic apparatus 101 may recognize whether the application execution menu is configured to be an active state in operation 1101. The application execution menu may include a menu for configuring whether to execute a predefined application (e.g., a menu application) based on the removal of the electronic pen 200.

When the application execution menu is configured to be the active state (e.g., yes in operation 1101 of fig. 11), the electronic apparatus 101 may execute a predefined memo application based on the removal of the electronic pen 200 in operation 1103. For example, the memo application is configured to be executed in the low power mode, and may include at least a part of the application executed in the normal mode of the electronic apparatus 101, or may be a separate application.

In operation 1105, the electronic apparatus 101 may recognize whether a first input through a button of an electronic pen located outside the hovering area is detected in a state in which the memo application is executed. For example, the processor 120 may recognize whether a signal corresponding to a first input through a button of the electronic pen 200 is received through the communication module 190 (e.g., short-range communication) in a state where a hovering input through the electronic pen 200 is not detected. For example, the state in which no hovering input is detected may include a state in which a magnitude of an electromagnetic field of the electronic pen 200 is smaller than a reference magnitude.

When the first input through the button of the electronic pen 200 located outside the hovering area is not detected (e.g., no in operation 1105 of fig. 11), the electronic apparatus 101 may keep executing the memo application in operation 1103.

When a first input through a button of the electronic pen 200 located outside the hovering area is detected (e.g., yes in operation 1105 of fig. 11), the electronic apparatus 101 may execute a camera application in operation 1107. For example, the processor 120 may execute a camera application in a state of maintaining a locked state of the electronic device 101. In this case, the display device 160 may display the image acquired by the camera module 180 on a higher display layer of the lock screen of the electronic device 101. The image acquired by the camera module 180 may include an image acquired by a front camera whose orientation is set to be the same as the orientation of the display device 160 of the electronic device 101.

When the application execution menu is configured to be in the inactive state (no in operation 1101 of fig. 11), the electronic apparatus 101 may recognize whether an input of a button of the electronic pen 200 located within the hovering area is detected in operation 1109. For example, the processor 120 may identify whether a signal corresponding to a button input is received from the electronic pen 200 through the communication module 190 (e.g., short-range communication) in a state in which a hover input of the electronic pen 200 is maintained. When a hovering input by the electronic pen 200 is maintained, the display device 160 may display a location where the hovering input is detected. For example, the button input of the electronic pen 200 may include at least one of a single press, a double press, and a long press.

When an input of a button of the electronic pen 200 located within the hovering area is detected (e.g., yes in operation 1109 of fig. 11), the electronic apparatus 101 may execute a memo application in operation 1111. For example, the processor 120 may execute the memo application in a state where the locked state of the electronic apparatus 101 is maintained.

When an input of a button of the electronic pen 200 located within the hovering area is not detected (e.g., no in operation 1109 of fig. 11), the electronic apparatus 101 may recognize whether a first input through a button of the electronic pen 200 located outside the hovering area is detected in operation 1113. For example, the processor 120 may recognize whether a signal corresponding to a first input through a button of the electronic pen 200 is received through the communication module 190 (e.g., short-range communication) in a state in which the intensity of the electromagnetic field received from the electronic pen 200 is less than a reference magnitude. For example, a first input through a button may indicate an input that: the pressing (input) of the button in the electronic pen 200 is continuously maintained for the third reference time by the input.

When the first input through the buttons of the electronic pen 200 located outside the hovering area is not detected (e.g., no in operation 1113 of fig. 11), the electronic apparatus 101 may recognize whether the input of the buttons of the electronic pen 200 located within the hovering area is detected in operation 1109.

When a first input through a button of the electronic pen 200 located outside the hovering area is detected (e.g., yes in operation 1113 of fig. 11), the electronic apparatus 101 may execute a camera application in operation 1115. For example, the display device 160 may display an image (preview image) acquired by the camera module 180 on a higher display layer of the lock screen of the electronic device 101. The image acquired by the camera module 180 may include an image acquired by a front camera whose orientation is set to be the same as the orientation of the display device 160 of the electronic device 101.

Fig. 12 is a flowchart 1200 illustrating an operation of an electronic device to execute an application based on a button input through an electronic pen according to an embodiment of the present disclosure.

Hereinafter, the electronic device may include the electronic device 101 of fig. 1 or at least a portion of the electronic device 101 (e.g., the processor 120).

Referring to fig. 12, the electronic apparatus 101 may provide a service associated with the electronic pen 200 in operation 1201. For example, the processor 120 may execute at least one application in a state where the electronic pen 200 is removed from the electronic device 101.

In operation 1203, the electronic device 101 may identify whether an event for switching to a low power mode is generated. For example, when the electronic apparatus 101 does not receive an input within the second predetermined time, the processor 120 may determine that an event of switching to the low power consumption mode is generated.

When an event for switching to the low power mode is not generated (e.g., no in operation 1203 of fig. 12), the electronic apparatus 101 may execute at least one application in a state where the electronic pen 200 is moved out in operation 1201.

When an event for switching to the low power mode is generated (e.g., yes in operation 1203 of fig. 12), the electronic apparatus 101 may switch the operation mode of the electronic apparatus 101 to the low power mode in operation 1205. For example, the low power mode may include an operating mode for deactivating at least one module (e.g., the processor 120 and the display device 160) included in the electronic device 101 to reduce the amount of power consumed by the electronic device 101.

In operation 1207, the electronic apparatus 101 may identify whether an input of a button of the electronic pen 200 located within the hovering area is detected in the low power mode. For example, the processor 120 may determine that the electronic pen 200 is located within the hovering area when an electromagnetic field greater than or equal to a reference magnitude is received from the electronic pen 200. The processor 120 may recognize whether a signal corresponding to a button input is received from the electronic pen 200 through the communication module 190 (e.g., short-range communication) in a state where an electromagnetic field greater than or equal to a reference magnitude is continuously received from the electronic pen 200. For example, the button input of the electronic pen 200 may include at least one of a single press, a double press, and a long press.

When an input of a button of the electronic pen 200 located within the hovering area is detected (e.g., yes in operation 1207 of fig. 12), the electronic apparatus 101 may execute a memo application in operation 1209. For example, the processor 120 may control the display device 160 to display the user interface of the memo application such that it overlaps at least a portion of the lock screen of the electronic device 101 displayed on the display device 160.

When the input of the button of the electronic pen 200 located within the hovering area is not detected (e.g., no in operation 1207 of fig. 12), the electronic apparatus 101 may recognize whether the input of the button of the electronic pen 200 located outside the hovering area is detected in operation 1211. For example, the processor 120 may recognize whether a signal corresponding to a button input of the electronic pen 200 is received through the communication module 190 (e.g., short-range communication) in a state where a hover input through the electronic pen 200 is not detected. For example, the state in which no hovering input is detected may include a state in which: in this state, an electromagnetic field smaller than a reference magnitude is received from the electronic pen 200 or no electromagnetic field is received from the electronic pen 200.

When input of a button of the electronic pen 200 located outside the hovering area is not detected (e.g., no in operation 1211 of fig. 12), the electronic apparatus 101 may recognize whether input of a button of the electronic pen 200 located within the hovering area is detected in a low power mode in operation 1207.

When an input of a button of the electronic pen 200 located outside the hovering area is detected (e.g., yes in operation 1211 of fig. 12), the electronic apparatus 101 may recognize whether the button input of the electronic pen 200 corresponds to the first input in operation 1213. For example, the first input may be input by continuously maintaining the pressing (input) of the button of the electronic pen 200 for the third reference time.

When the electronic apparatus 101 receives the first input from the electronic pen 200 located outside the hovering area (e.g., yes in operation 1213 of fig. 12), the electronic apparatus 101 may unlock the electronic apparatus 101 and execute the camera application in operation 1215. For example, when a long press input is received from the electronic pen 200 located outside the hovering area, the processor 120 may determine that the user is continuously using the electronic apparatus 101. Accordingly, the processor 120 may unlock the electronic device 101 and execute the camera application.

When the second input is received from the electronic pen 200 located outside the hovering area (e.g., no in operation 1213 of fig. 12), the electronic apparatus 101 may unlock the electronic apparatus 101 in operation 1217. Display device 160 may display a user interface that is displayed just prior to electronic device 101 switching to the low power mode. For example, the second input may include a single-press or a double-press of a button of the electronic pen 200.

According to various embodiments of the present disclosure, a method of operating an electronic device (e.g., electronic device 101 of fig. 1) may include: an operation of recognizing whether or not an electronic pen (e.g., the electronic pen 200 of fig. 2) is removed from the recess in the low power mode, the electronic pen being insertable into the recess provided in the housing interior of the electronic device and extending for a long length so as to be removable from the recess; an operation of recognizing information related to the electronic pen when the electronic pen is removed from the recess; and executing the application based on at least a portion of the information related to the electronic pen.

According to various embodiments, the information relating to the electronic pen comprises at least one of: whether a hovering input by the electronic pen is detected, a time point at which the hovering input is detected, an orientation of the electronic pen, input information of a button included in the electronic pen.

According to various embodiments, the operation of identifying information related to the electronic pen may include the operations of: at least one of an orientation of the electronic pen and input information of a button included in the electronic pen is received from the electronic pen through short-range wireless communication using a wireless communication circuit (e.g., the communication module 190 of fig. 1) of the electronic device.

According to various embodiments, the short-range wireless communication may include at least one of bluetooth and Bluetooth Low Energy (BLE).

According to various embodiments, the operation of executing the application may include: an operation of acquiring input information of a button included in the electronic pen; executing an operation of a memo application when input information of a button included in the electronic pen satisfies a first predetermined condition; and performing an operation of the camera application when input information of a button included in the electronic pen satisfies a second predetermined condition.

According to various embodiments, the first predetermined condition may comprise a condition relating to input of a button of the electronic pen located within the hovering area, and the second predetermined condition may comprise a condition relating to input of a button of the electronic pen located outside the hovering area.

According to various embodiments, the operation of executing the application may include: performing an operation of the camera application when the orientation of the electronic pen is maintained in the first orientation for a predetermined time; and performing an operation of the memo application when the orientation of the electronic pen is maintained in the second orientation for a predetermined time.

According to various embodiments, the orientation of the electronic pen may be recognized based on sensing data of a 6-axis sensor included in the electronic pen received from the electronic pen through short-range wireless communication.

With the electronic device and the operating method thereof according to various embodiments, a user of the electronic device can easily use the electronic pen by performing an operation mode related to the electronic pen based on at least one of input through the electronic pen, application information, and an orientation of the electronic pen.

With the electronic apparatus and the operating method thereof according to various embodiments, when the electronic pen is moved out in the low power mode, it is possible to increase user convenience of use of the electronic pen by executing an application corresponding to an input related to the electronic pen.

While the disclosure has been shown and described with reference to various embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the disclosure as defined by the appended claims and their equivalents.