阅读说明：本技术 电子装置和用于控制电子装置的方法 (Electronic device and method for controlling electronic device ) 是由 梁希汀 柳知相 李常源 李仁东 林幸宣 于 2019-07-10 设计创作，主要内容包括：提供了一种电子装置。控制电子装置的方法包括：显示至少一个句子,当接收到关于所显示的至少一个句子的至少一个字符的用户输入时,通过使用至少一个字符和包括至少一个字符的至少一个句子来分析至少一个句子,根据分析结果选择包括在至少一个句子中的字符集,以及与包括在至少一个句子中的其它字符区分开地显示所选择的字符集。(An electronic device is provided. The method for controlling the electronic device comprises the following steps: the method includes displaying at least one sentence, analyzing the at least one sentence by using the at least one character and the at least one sentence including the at least one character when a user input regarding the at least one character of the displayed at least one sentence is received, selecting a character set included in the at least one sentence according to a result of the analysis, and displaying the selected character set separately from other characters included in the at least one sentence.)

1. An electronic device, comprising:

a display;

a processor; and

a memory for storing a plurality of data to be transmitted,

wherein the memory stores instructions that enable the processor to:

controlling the display to display at least one sentence:

receiving user input regarding at least one character of the displayed at least one sentence;

analyzing the at least one sentence by using the at least one character and the at least one sentence including the at least one character in response to the user input;

selecting a character set included in the at least one sentence according to the analysis result; and

displaying the selected character set separately from other characters included in the at least one sentence.

2. The electronic device of claim 1, wherein the character set includes at least one character corresponding to the user input.

3. The electronic device of claim 2, wherein the character set comprises a plurality of characters.

4. The electronic device of claim 3, wherein the character set comprises a plurality of characters disposed adjacent to one another.

5. The electronic device of claim 1, wherein the instructions enable the processor to: in performing a search by using the identified character set, a search category is identified based on contents of other character sets included in the at least one sentence.

6. The electronic device of claim 1, wherein the instructions enable the processor to:

obtaining a plurality of character set candidates, each character set candidate including a character selected corresponding to the user input and at least one adjacent character;

obtaining a plurality of candidate sentences respectively corresponding to the plurality of character set candidates; and

the obtained plurality of candidate sentences are analyzed, one candidate sentence is selected, and a character set corresponding to the selected one candidate sentence is selected.

7. The electronic device of claim 6, wherein the instructions enable the processor to: when the plurality of character set candidates are replaced with other character sets, the at least one sentence is analyzed based on obtaining a continuity score according to a correlation between the replaced character set and other characters or other words included in the plurality of candidate sentences.

8. The electronic device of claim 6, wherein the instructions enable the processor to: analyzing the at least one sentence based on obtaining the generality score according to the frequency of use and the importance of the characters or words included in each of the plurality of character set candidates.

9. The electronic device of claim 1, wherein the instructions enable the processor to: analyzing the at least one sentence according to a classification of sentence components of the at least one sentence, the at least one sentence including the at least one character selected corresponding to the user input according to the grammatical features of the sentence components.

10. The electronic device of claim 1, wherein the instructions enable the processor to: using a search history previously stored in the memory in analyzing the at least one sentence.

11. The electronic device of claim 1, further comprising a communication module,

wherein the instructions enable the processor to: control the communication module to transmit the at least one character and the at least one sentence including the at least one character to a server, and receive a result of selecting a character set included in the at least one sentence by analyzing the at least one sentence using the at least one character and the at least one sentence including the at least one character by the server.

12. A server, comprising:

a communication module;

a processor; and

a memory for storing a plurality of data to be transmitted,

wherein the memory stores instructions that enable the processor to:

controlling the communication module to receive at least one character and a sentence including the at least one character from an external device, wherein, in response to the receiving, the processor analyzes the sentence by using the at least one character and the sentence including the at least one character;

selecting a character set contained in the sentence according to the analysis result; and

controlling the communication module to transmit the selected character set to the external device.

13. A method of controlling an electronic device, the method comprising:

displaying at least one sentence;

analyzing the at least one sentence by using the at least one character and the at least one sentence including the at least one character when a user input regarding the at least one character of the displayed at least one sentence is received;

selecting a character set contained in the at least one sentence according to the analysis result; and

displaying the selected character set separately from other characters included in the at least one sentence.

14. A computer-readable recording medium having stored therein instructions for execution on a computer to:

displaying at least one sentence;

analyzing the at least one sentence by using the at least one character and the at least one sentence including the at least one character when a user input regarding the at least one character of the displayed at least one sentence is received;

selecting a character set included in the at least one sentence according to the analysis result; and

displaying the selected character set separately from other characters included in the at least one sentence.

Technical Field

The present disclosure relates to a method for selecting content displayed on a display of an electronic device comprising the display.

Background

Recently, electronic devices may provide various contents through a display. For example, the electronic device may display images, video, or text on the display. The electronic device may support an operation of searching for additional information corresponding to a user input to select content displayed on the display.

For example, the electronic device may enlarge the image or provide photographic information for selecting the image in response to user input. Further, the electronic device may provide a meaning or related information of the text for selecting the text in response to the user input.

Disclosure of Invention

Technical problem

When a user selects some characters displayed on a display to search for meanings of characters or related information, the user may experience inconvenience in precisely adjusting start and end points of characters to be searched.

Accordingly, various embodiments of the present invention are provided to easily display a character range when a user selects a character.

Drawings

Fig. 1A and 1B illustrate a state in which a plurality of characters are recognized and displayed according to a user's selection on an electronic device according to an embodiment.

Fig. 2 is a schematic block diagram of an electronic device according to an embodiment.

Fig. 3 illustrates a state in which a general score of a character set is used to identify one of a plurality of character sets on an electronic device according to an embodiment.

Fig. 4 illustrates a state in which an electronic device recognizes a character set including a plurality of characters by using a grammatical structure of a sentence according to an embodiment.

Fig. 5 illustrates a state in which the electronic device recognizes a character set including a plurality of characters that are not adjacent to each other.

Fig. 6 illustrates a state of identifying one of a plurality of character sets on an electronic device using a search history according to an embodiment.

Fig. 7 illustrates a state in which the electronic device selects a search category in consideration of the contents of a sentence.

Fig. 8 illustrates an embodiment in which an electronic device displays a selected region notification object according to an embodiment.

Fig. 9 is a block diagram of an electronic device according to various embodiments.

Fig. 10 is a flowchart of an electronic device recognizing and displaying a state of a plurality of characters according to an embodiment.

Fig. 11 is a flow diagram of a state in which an electronic device according to an embodiment is associated with a server to recognize and display a plurality of characters.

Fig. 12 is a block diagram of an electronic device in a network environment, in accordance with various embodiments.

Detailed Description

According to one aspect of the disclosure, an electronic device includes a display, a processor, and a memory, where the memory stores instructions that enable the processor to: controlling a display to display at least one sentence received in response to a user input with respect to at least one character of the displayed at least one sentence, analyzing the at least one sentence in response to the user input by using the at least one character and the at least one sentence including the at least one character, selecting a character set included in the at least one sentence according to a result of the analysis, and displaying the selected character set to be distinguished from other characters included in the at least one sentence.

In an embodiment, the character set may include at least one character corresponding to the user input.

In an embodiment, a character set may include a plurality of characters.

In an embodiment, the character set may include a plurality of characters adjacent to each other.

In an embodiment, the instructions may enable the processor to: when a search is performed by using the identified character set, a search category is identified based on contents of other character sets included in at least one sentence.

In an embodiment, the instructions may enable the processor to:

obtaining a plurality of character set candidates, each of the character set candidates including a character selected corresponding to a user input and at least one adjacent character, obtaining a plurality of candidate sentences corresponding to the plurality of character set candidates, respectively; and

the obtained plurality of candidate sentences are analyzed, one candidate sentence is selected, and a character set corresponding to the selected one candidate sentence is selected.

In an embodiment, the instructions may enable the processor to: at least one sentence is analyzed based on obtaining a coherence score according to a correlation between the replaced character set and other characters or other words included in the plurality of candidate sentences when the plurality of character set candidates are replaced with other character sets.

In an embodiment, the instructions may enable the processor to: at least one sentence is analyzed based on obtaining a general score according to the frequency of use and the importance of the character or word included in each of the plurality of character set candidates.

In an embodiment, the instructions may enable the processor to:

at least one sentence is analyzed based on a classification of sentence components of the at least one sentence including at least one character selected corresponding to the user input according to grammatical features of the sentence components.

In an embodiment, the instructions may enable the processor to use a search history previously stored in the memory when analyzing the at least one sentence.

In an embodiment, the electronic device may further include a communication module, wherein the instructions enable the processor to control the communication module to transmit the at least one character and the at least one sentence including the at least one character to the server, and receive a result of selecting the set of characters included in the at least one sentence by analyzing the at least one sentence using the at least one character and the at least one sentence including the at least one character by the server.

According to another aspect of the present disclosure, a server includes a communication module, a processor, and a memory, wherein the memory stores instructions that enable the processor to control the communication module to receive at least one character and a sentence including the at least one character from an external device, wherein in response to the receiving, the processor analyzes the sentence by using the at least one character and the sentence including the at least one character, selects a character set included in the sentence according to a result of the analysis, and controls the communication module to transmit the selected character set to the external device.

According to another aspect of the present disclosure, a control method of an electronic device includes: the method includes displaying at least one sentence, analyzing the at least one sentence by using the at least one character and the at least one sentence including the at least one character when a user input regarding the at least one character of the displayed at least one sentence is received, selecting a character set included in the at least one sentence according to a result of the analysis, and displaying the selected character set to be distinguished from other characters included in the at least one sentence.

According to another aspect of the present disclosure, a computer-readable recording medium stores instructions executable on a computer to display at least one sentence, analyze the at least one sentence by using at least one character and at least one sentence including the at least one character when a user input with respect to the at least one character of the displayed at least one sentence is received, select a character set included in the at least one sentence according to a result of the analysis, and display the selected character set to be distinguished from other characters included in the at least one sentence.

Embodiments of the present disclosure

Since the present disclosure is susceptible to various modifications and embodiments, the embodiments will be shown in the drawings and described in detail in the written description. However, this is not intended to limit the present disclosure to the specific embodiments, and it should be understood that various modifications, equivalents, and/or alternatives falling within the spirit and technical scope of the present disclosure are also included in the present disclosure. In the description of the present disclosure, certain detailed explanations of related art are omitted when it is considered that they may unnecessarily obscure the essence of the present disclosure.

In this specification, it should be understood that terms such as "including", "having", and "comprising" are intended to indicate the presence of the features, numbers, steps, actions, components, parts, or combinations thereof disclosed in the specification, and are not intended to preclude the possibility of one or more other features, numbers, steps, actions, components, parts, or combinations thereof being present or added.

In this specification, expressions such as "a or B", "at least one of a and/or B", or "at least one or more of a and/or B" may include all possible combinations of the items listed together. For example, expressions such as "a or B", "at least one of a and B", or "at least one of a or B" may mean: (1) comprises at least one A; (2) comprises at least one B; or (3) all cases including both at least one a and at least one B.

Terms such as "first" and "second" are used herein only to describe various constituent elements regardless of order and/or importance, and to distinguish one constituent element from another constituent element, but the constituent elements are not limited by these terms. For example, the first user device and the second user device may represent different user devices regardless of order and/or importance. For example, a first constituent element may be referred to as a second constituent element, and vice versa, without departing from the proper scope of the present disclosure.

Also, the terms "module", "unit" and "means" set forth in the specification may denote a unit that processes at least one function or operation, and the unit may be embodied by hardware, software, or a combination of hardware and software. Further, a plurality of "modules", "units", and "components" and the like may be integrated in at least one module or chip to be implemented as at least one processor, except for the case where each of the modules, units, and components needs to be implemented by separate specific hardware.

In the present specification, when a constituent element (e.g., a first constituent element) is (operatively or communicatively) coupled or connected to another constituent element (e.g., a second constituent element), the constituent element is in contact with or connected to the other constituent element directly or through at least one other constituent element (e.g., a third constituent element). In contrast, when a constituent element (e.g., a first constituent element) is described as being directly connected or directly coupled to another constituent element (e.g., a second constituent element), the constituent element should be construed as being directly connected to the other constituent element without any other constituent element (e.g., a third constituent element) interposed therebetween.

The terminology used in the description is for the purpose of describing particular embodiments and is not intended to be limiting of the disclosure. Thus, reference to the use of the singular in the specification also includes reference to the use of the plural unless the context clearly dictates otherwise. Unless otherwise defined, all terms (including technical or scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs. Terms defined in commonly used dictionaries are to be interpreted as having a meaning that matches that in the context of the relevant art and, unless otherwise explicitly defined, is not to be interpreted as ideal or overly formal. In some instances, even terms defined herein are not to be construed as exclusive of embodiments of the present disclosure.

Fig. 1A and 1B illustrate a state in which a plurality of characters are recognized and displayed according to a user's selection on an electronic device according to an embodiment.

According to an embodiment, the electronic device 10 may display various contents on the display 11. For example, the electronic device 10 may display content such as images, videos, texts, etc. on the display 11. The display 11 may comprise a touch screen display. The electronic device 10, in response to user input selecting various content displayed on the display 11, may provide new information related to the selected content, or identify a portion of the selected content and provide the identified portion to the user separately from another portion of the content.

Referring to reference numeral 1-a of FIG. 1A, the electronic device 10 may display characters on the display 11.

For example, the electronic device 10 may display characters on the display 11 by executing a document file (e.g., a word document file, a Portable Document Format (PDF) file, etc.) stored in the electronic device 10. For example, an Operating System (OS) running on the electronic device 10 may control a word file execution application that may execute a word document file to execute the word document file selected by the user to be displayed on the display 11.

Alternatively, the electronic device 10 may display the characters on the display 11 by accessing a web server to download an online magazine, an online newspaper, or the like. For example, the OS running on the electronic device 10 may download an online magazine, an online newspaper, or the like from a web server in a file format. The OS may control an execution application capable of executing the downloaded file to execute the document file to be displayed on the display 11.

Alternatively, when the web server accesses the electronic device 10 to control the display 11 of the electronic device 10, an online magazine, an online newspaper, or the like may be displayed on the web server.

Referring to reference numerals 1-b of FIG. 1A, the electronic device 10 may receive a user input 105 to select at least one of the characters displayed on the display 11.

According to an embodiment, the user may select at least one character to conduct an additional search for a specific word, a specific phrase, a specific clause, or a specific sentence included in the article displayed on the display 11. For example, the electronic device 10 may receive a user touch input 105 fromThe words displayed on the display 11, i.e.,110, the selection of a character, i.e.,112. according to an embodiment, the user touch input 105 may be a touch for a preset time or more112, or multiple touches within a set time112. However, the user touch input 105 is not limited thereto.

According to various embodiments, when a user manipulates physical keys included in the electronic device 10, the electronic device 10 may receive a secondary word (i.e.,110) in selection112.

According to an embodiment, in response to a user input selecting at least one character displayed on the display 11, the electronic device 10 may analyze a sentence including the at least one character by using the sentence and the at least one character, and select a character set included in the sentence according to the analysis result.

For example, the electronic device 10 may obtain a plurality of character set candidates including the selected character and at least one adjacent character corresponding to the user input, obtain a plurality of candidate sentences respectively corresponding to the plurality of character set candidates, analyze the obtained candidate sentences, select one candidate sentence, and select a character set corresponding to the selected one candidate sentence.

In detail, in response to a user selection, the electronic device 10 may obtain a character set including the selected character and at least one adjacent character. Obtaining a character set may mean, for example, determining a character set that includes the selected character and characters that occur within a preset distance from the selected character. The electronic device 10 may obtain a plurality of character set candidates by repeatedly performing the operation of obtaining the character set.

For example, the electronic device 10 may determine to includeIs/are as follows Etc. as character set candidates, whereinThe character selected by the user.

According to an embodiment, the electronic device 10 may obtain a plurality of candidate sentences respectively corresponding to a plurality of character set candidates, analyze the obtained candidate sentences, select one candidate sentence, and select a character set corresponding to the selected one candidate sentence.

For example, the electronic device 10 may obtain the continuity score of the character set candidate by analyzing the obtained candidate sentence.

Analyzing a sentence may mean, for example, the electronic device 10 analyzing the correlations between characters or words that form the sentence. Alternatively, analyzing a sentence may mean the operation of: for example, it is recognized whether the relationship between characters or words forming a sentence is continuous or discontinuous. Alternatively, analyzing a sentence may mean, for example, analyzing grammatical relations between characters or words that form the sentence. Alternatively, analyzing a sentence may mean, for example, analyzing grammatical roles of characters or words that form the sentence. Alternatively, analyzing the sentences may mean performing the above-described analysis processes sequentially or simultaneously.

According to an embodiment, the consistency score may be a score given to the character set as a result of the analysis of the sentence described above. For example, the consistency score may be a score given to the character set when the electronic device 10 calculates a degree of consistency in the relationship between the character set and other characters in the candidate sentence.

For example, the electronic device 10 may be obtained to include112(which is a candidate sentence) in which112 are characters selected by the user. The operation of obtaining candidate sentences including characters selected by the user may mean, for example, determining the candidate sentences by using an Artificial Intelligence (AI) model trained to distinguish boundaries between sentences by using an end word for terminating a sentence.

The electronic apparatus 10 may obtain an inclusion included in the obtained candidate sentence112 as a character set. For example, the electronic device 10 may determine to include112 (which are user-selected characters) Etc. as a character set. However, the present disclosure is not limited thereto. For example, the electronic device 10 may obtain an inclusion beyond the obtained candidate sentence range112 as a character set. In this case, the electronic apparatus 10 may exclude a character set that does not form a word from the obtained character set.

For example, as in reference numerals 1-c of FIG. 1B, the electronic device 10 may obtain the first character set candidateFurther, the electronic device 10 may obtainAs a second character set candidate and obtainingAs a third character set candidate.

According to various embodiments, the electronic device 10 may obtain, for example, a first character set candidate, a second character set candidate, and a third character set candidate, and combine the obtained character set candidates with another character in the sentence to generate a new character set candidate.

According to an embodiment, the electronic device 10 may obtain the continuity scores with respect to the plurality of character set candidates based on an analysis of a candidate sentence including the obtained character set. For example, when the obtained character set candidate is replaced with other words, the electronic device 10 may distinguish whether the replaced words have independence or dependency related to other words or characters included in the sentence.

According to an embodiment, the electronic device 10 may select a character set from the plurality of character set candidates according to the coherence score. One character set selected by the electronic device 10 may be, for example, a character set having a high consistency score according to a sentence analysis result. The character set with a high consistency score may be, for example, a character set that is highly likely to be selected by a user.

In detail, the electronic device 10 may operateIs applied to the sentence instead of the first character set candidate, the second character set candidate, and the third character set candidate.

For example, when the continuity score approaches 1, this may mean that the character set candidate is likely to be used by connecting to other characters included in the candidate sentence. Further, when the continuity score is closer to 0, this may mean that the character set candidate is highly unlikely to be used by being connected to other characters included in the candidate sentence.

For example, the electronic device 10 may wordInstead of the first character set candidates, is applied to the candidate sentence, and the candidate sentence is obtained

The electronic device 10 may be able to make a wordInstead of the second character set candidate and the third character set candidate, is applied to the candidate sentence, and the candidate sentence is obtained And

the electronic device 10 can be connected withIt is recognized that there is no character set, although it is not syntactically incorrect in the candidate sentence, and a consistency score of 0.72 is given.

The electronic device 10 can be connected withA less frequently used character set is identified in which the postword is syntactically omitted in the candidate sentence, and a continuity score of 0.65 is given.

The electronic device 10 can be connected withIdentified as a character set that is combinable and has no grammatical errors in the candidate sentence, and gives a consistency score of 0.78.

Based on the recognition result, the electronic device 10 may recognize the character as a first character set candidateWith the greatest consistency score. In other words, the consistency score may mean a degree of fluency in the syntax or meaning of the replacement character set in relation to other character sets of the candidate sentence when one character set is replaced by another character set in the candidate sentence.

According to various embodiments, the electronic device 10 that analyzes the candidate sentences to obtain the consistency score may be one of the embodiments of the present disclosure. For example, the electronic device 10 may analyze a phrase to which the character set belongs, a clause to which the character set belongs, a paragraph to which the character set belongs, or a document to which the character set belongs. In other words, the electronic device 10 may analyze a plurality of characters forming a sentence, phrase, clause, paragraph, or document, and select one character set included in the characters.

Referring to reference numerals 1-d of FIG. 1B, the electronic device 10 may display the selected region notification object on the display 11 to display the identified one character set so as to be distinguished from other characters.

For example, the electronic device 10 may display and include the identified character by changing the color of the region 120The adjacent area 120 of the character set. However, the present disclosure is not limited thereto. For example, the electronic device 10 may display the character in a color different from the color of other characters, or by changing the thickness of the character

According to various embodiments, when displayed by changing its colorAdjacent region 120, electronic device 10 may receive user input to select another character displayed on display 11, for exampleIs/are as followsIn this case, the electronic device 10 terminates the display by changing its colorAdjacent regions 120 and sequentially displayed by changing their colorsAdjacent regions.

In this way, according to the embodiments of the present disclosure, when the user attempts to perform an additional search or the like by selecting a word display on the display 11, the inconvenience of adjusting the start point and the end point of each of the words, phrases, and clauses to select a desired word, phrase, or clause can be reduced. For example, as described above, when the user selects only one character, a character set including the selected character and highly likely to be selected by the user is recognized and displayed separately from other characters, in consideration of the meaning and/or structure of a sentence including the selected character.

Fig. 2 is a schematic block diagram of an electronic device according to an embodiment.

Referring to fig. 2, the electronic device 10 may include a processor 210, a display 220, and a memory 230. The electronic device 10 may also include a communication module 240. However, the present disclosure is not limited thereto. The electronic device 10 may include more constituent elements or exclude some constituent elements to perform the functions of the electronic device 10.

According to an embodiment, the processor 210 may control the overall operation of the electronic device 10. For example, the processor 210 may execute a stored program or retrieve or store necessary information by controlling the memory 230.

According to an embodiment, the processor 210 may control the display 220 to display at least one sentence, receive a user input with respect to at least one character of the displayed sentence, analyze the sentence by using the at least one character and the sentence including the at least one character, select a character set included in the sentence according to an analysis result in response to the user input, and display the selected character set to be distinguished from other characters included in the sentence.

According to various embodiments, the electronic device 10 may include multiple processors. For example, the electronic device 10 may include a general purpose processor and an AI-specific processor.

The AI-specific processor may be, for example, a processor that is more integrated, has less latency, has better performance, or more resources than a general-purpose processor.

According to embodiments, the AI processor may quickly and efficiently handle the large amount of computation required to generate, update, or apply the AI model as compared to a general purpose processor.

According to an embodiment, the general purpose processor may control the display 220 to display at least one sentence, receive user input to select at least one character of the displayed sentence, and select a sentence including the selected character.

The AI processor may receive the selected character and the sentence including the selected character from the general processor, analyze the sentence by using the selected character and the sentence including the selected character, select a character set included in the sentence according to the analysis result, and transmit the selected character set to the general processor. For example, the AI processor may obtain a plurality of character set candidates that include the selected character, generate a continuity score for the character set candidates, and select a character set.

The general purpose processor may display the received character set to distinguish it from other characters.

However, the operations performed by each processor are not limited thereto. For example, the electronic device 10 may allow each processor to perform operations individually in various forms.

According to an embodiment, the display 220 may display an image, a video, a text, and/or an execution screen of an application. When the display 220 is implemented as a touch screen display, the display 220 may also serve as an input device in addition to an output device. The display 220 may include at least one of a liquid crystal display, a thin film transistor-liquid crystal display, an organic light emitting diode, a flexible display, a 3D display, an electrophoretic display, and the like.

According to an embodiment, the display 220 may display at least one sentence and receive a user input to select at least one character included in the displayed sentence under the control of the processor 210. In addition, the display 220 may display a set of recognized characters to be distinguished from other characters under the control of the processor 210.

According to an embodiment, the memory 230 may include at least one type of storage medium, such as a flash memory, a hard disk, a multimedia card microcomputer, a card type memory, such as an SD or XD memory, a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a Read Only Memory (ROM), an electrically erasable programmable ROM (eeprom), a programmable ROM (prom), a magnetic memory, a magnetic disk, an optical disk, and the like.

According to an embodiment, the memory 230 may store instructions configured to cause the processor 210 to control the display 220 to display at least one sentence, receive a user input regarding at least one character of the displayed sentence, analyze the sentence by using the at least one character and the sentence including the at least one character in response to the user input, select a character set included in the sentence according to an analysis result, and display the selected character set so as to be distinguished from other characters included in the sentence.

According to an embodiment, the communication module 240 may connect the electronic device 10 to an external device, e.g., a server, another electronic device, under the control of the processor 210. The communication module 240 may include one of constituent elements implementing various wired or wireless communication methods such as a wireless Local Area Network (LAN), bluetooth, and wired ethernet, depending on the performance and structure of the electronic device 10.

FIG. 3 illustrates a state in which a generic score for a character set is used to identify one of a plurality of character sets on an electronic device, according to an embodiment.

According to an embodiment, the electronic device 10 may calculate the general score considering the frequency with which a character set including a word, phrase, or clause is used in a sentence, paragraph, or document, and store the general score as a database in the memory 230. The general score may be a score used to determine whether a character set in a sentence, paragraph, or document is likely to be selected by a user for searching.

For example, the generality score may be determined in consideration of at least one of a frequency of use of the character set, a degree of importance of the character set, and a likelihood of additional searches using the character set. However, the factors to be considered in determining the generic score are not limited thereto.

The generality score may be determined, for example, according to whether the user is more likely to select a character set for additional information, because while character sets are typically used infrequently in sentences, paragraphs, or documents, character sets have and therefore serve as important meanings in sentences, paragraphs, or documents when used in sentences, paragraphs, or documents.

The generality score may be determined, for example, according to whether many people are likely to search for additional information about the character set, because while character sets are typically used infrequently in sentences, paragraphs, or documents, many people are curious about character sets when used in sentences, paragraphs, or documents.

The generality score may be close to 1, for example, when the frequency is relatively high and the probability of searching for additional information is relatively low. Further, when the frequency is relatively low and the probability of searching for additional information is relatively high, the generality score may approach 0.

Referring to reference numeral 3-a of fig. 3, the electronic device 10 may store a general score with respect to a character set including a word, phrase, or clause. For example, the electronic device 10 may be paired with a plurality of sentences or documents that are data collections and classified into a plurality of character setsGiving 0.73456 points, pairsGiving 0.52679 points, pairGiving 0.41181 points, pairsGiving point 0.01220.

Referring to reference numeral 3-b of FIG. 3, the electronic device 10 may identifyIs composed ofA sentence (which is a character selected by the user). The electronic device 10 may obtain the inclusion in the sentenceAs a character set. In addition, the electronic device 10 may obtain the inclusion in the sentenceAdjacent character sets. For example, the electronic device 10 may obtain Andas character set candidates.

According to an embodiment, the electronic device 10 may be configured to obtain a plurality of character set candidates based on the plurality of character set candidatesA character set identified as having a low frequency and a high probability of searching for additional information.

As indicated by reference numerals 1-d of FIG. 1B, the electronic device 10 may display the selected regional notification object 120 on the display 11 to display the identified character set separately from other characters.

FIG. 4 illustrates a state in which an electronic device recognizes a character set including a plurality of characters by using a grammatical structure of a sentence according to an embodiment

According to the embodiment, the electronic device 10 may classify sentence constituent elements of a sentence including characters selected by a user according to grammatical features of the sentence constituent elements. The electronic device 10 may store a sentence analysis algorithm on the memory 230, which can hierarchically classify sentence constituent elements (such as words, phrases, or clauses) included in one sentence into the level of nouns, postwords, or suffixes by using, for example, a tree structure.

The electronic device 10 may hierarchically classify words, phrases, or clauses in the sentence by parsing the recognized sentence. For example, the electronic device 10 may identify at least one of a noun phrase, a verb phrase, an adjective phrase, and an adverb phrase from the identified sentence. Further, the electronic device 10 may identify parts of speech of a character set classified from the identified sentences. The parts of speech recognized by the electronic device 10 may include, for example, a general noun, a suffix, and a suffix, but is not limited thereto.

For example, the electronic device 10 may identify", which is included as a character selected by the userThe sentence (1). The electronic device 10 may parse the recognized sentence.

For example, the electronic device 10 may be a mobile phoneIdentified as the first phrase in the sentence. In addition, the electronic device 10 may be a portable electronic deviceIdentified as a second phrase.

The electronic device 10 may phrase the first phraseIn (1)Is recognized as a third phrase and willIs identified as a first part of speech. The electronic device 10 can be connected withIs recognized as a fourth phrase and willIs recognized as a second part of speech, willIs recognized as a third part of speech, willIs recognized as a fourth part of speech, andis identified as a fifth part of speech. For example, the third phrase may be a noun phrase and the fourth phrase a noun phrase. For example, the first part of speech may be a general noun, the second part of speech may be a general noun, the third part of speech may be a suffix derived from a noun, the fourth part of speech may be a general noun, and the fifth part of speech may be a postword.

The electronic device 10 can be connected withThis phrase "is identified as the fifth phrase. The electronic device 10 may respectively select the fifth phraseIs identified Andas the sixth part of speech, the seventh part of speech, and the eighth part of speech, and identifiesAs the ninth part of speech. For example, the fifth phrase may be a noun phrase in the case of an adjective. For example, the sixth, seventh, and eighth parts of speech may be general nouns, and the ninth part of speech may be a postword.

According to an embodiment, the electronic device 10 may identify a set of characters included in a tree structure 410 that is the minimum level to which the user-selected character belongs. For example, the electronic device 10 may be a mobile phoneIdentified as a character set that is highly likely to be selected by the user.

According to various embodiments, the electronic device 10 may recognize only a portion composed of nouns other than a postword portion in the recognized character set as the character set. For example, the electronic device 10 may identifyIn addition to(which corresponds to the postword part) other thanAs a character set that is highly likely to be selected by the user.

Fig. 5 illustrates a state in which the electronic device recognizes a character set including a plurality of characters that are not adjacent to each other.

Referring to reference numeral 5-a of fig. 5, the electronic device 10 may display characters on the display 11. For example, the characters may be part of a newspaper article displayed on a web browser. However, the characters may not be limited to newspaper articles, and may include various contents using the characters.

According to an embodiment, the electronic device 10 may receive a user input 505 to select at least one of the characters displayed on the display 11.

According to an embodiment, the user may select at least one character to conduct an additional search for a specific word, a specific phrase, a specific clause, or a specific sentence included in the article displayed on the display 11. For example, the electronic device 10 may receive a user touch input to select the word 510 "down" displayed on the display 11.

Referring to reference numeral 5-b of fig. 5, the electronic apparatus 10 may obtain a plurality of character set candidates by repeating an operation of obtaining a character set including a character selected in response to a user selection and at least one adjacent character. Further, the electronic device 10 may obtain a plurality of candidate sentences respectively corresponding to the obtained character set candidates, analyze the obtained candidate sentences to select one candidate sentence, and identify a character set corresponding to the selected one candidate sentence as a character set highly likely to be searched for additional information by the user.

For example, the electronic device 10 may obtain the sentence "I had the equalizations down pat for my final exam" that includes "down" (which is a user-selected character). The electronic device 10 may obtain a plurality of characters including "down" as one character set.

For example, the electronic apparatus 10 may obtain a plurality of character set candidates including "down", "down pat", "equalizations down pat", or "had down pat". In this case, the electronic apparatus 10 may obtain a character set (e.g., "had down pat") including characters that do not directly neighbor the selected character as character set candidates.

According to the embodiment, the electronic apparatus 10 may analyze a sentence including the obtained character set and a sentence including the obtained character by using the obtained character, and identify one character set from among a plurality of character set candidates.

For example, when a character set candidate is replaced with other words, the electronic device 10 may identify a sentence having the appropriate sentence structure and meaning, and thus identify one of the plurality of character set candidates as a character set that is highly likely to be selected by the user for searching.

For example, the electronic device 10 may identify a character set by using a search history made by a user using the electronic device 10. Alternatively, the electronic device 10 may identify one character set among the plurality of character set candidates by using a general score of the character set. Alternatively, the electronic device 10 may identify one character set among the plurality of character set candidates by using a grammatical structure of the sentence.

Referring to reference numeral 5-b of FIG. 5, the electronic device 10 may identify "had down pat" among the plurality of character set candidates as a character set that is highly likely to be selected by the user for searching. For example, the electronic device 10 may recognize "had down pat" as a idiom and "had down pat" as a character set that is highly likely to be searched for additional information by using a grammar structure because the character set has an important meaning when used in a sentence although the character set is used less frequently.

Referring to reference numeral 5-c of fig. 5, the electronic device 10 may display the selected region notification object on the display 11 to display one character set recognized so as to be distinguished from other characters.

For example, the electronic device 10 may display the color of the region 520 so as to be different from the adjacent color with respect to the character set including the recognized character "had down pat", wherein the region 520 includes a region 521 adjacent to "had" and a region 522 adjacent to "down pat". However, the present disclosure is not limited thereto. For example, the electronic device 10 may display the character "had down pat" in a color different from other characters, or by changing the thickness of the character.

Fig. 6 illustrates a state of identifying one of a plurality of character sets on an electronic device using a search history according to an embodiment.

According to an embodiment, the electronic device 10 may store a search history made by a user using the electronic device 10 in the memory 230 as a database. For example, the electronic device 10 may display a web browser capable of information searching in response to user input on the display 11. The user can input a word, phrase, clause or sentence to be searched by using a web browser including a search window and check the search result.

According to an embodiment, the electronic device 10 may use a previously stored search history when obtaining a plurality of characters including a character selected corresponding to a user selection as one character set.

For example, in reference numerals 1-c of FIG. 1B, the electronic device 10 may obtainAs a first character set candidate. Further, the electronic device 10 may obtainAs a second character set candidate, and obtainingAs a third character set candidate.

The electronic apparatus 10 may analyze a sentence including the obtained character set by using the sentence including the obtained character set and the obtained character set, and check a search history previously stored in the electronic apparatus 10 when one character set of a plurality of character sets is to be recognized.

Referring to FIG. 6, the electronic device 10 may input the character set at 13:34 from 4/11/2018And provide a search history of its search results for examination. In addition, the electronic device 10 may input the character set from 2018, 4, 11, 27And provides a check in the search history of its search results.

According to the embodiment, the electronic apparatus 10 may match the first character set candidate matching the name of the disease among the first to third character set candidates by using the history of the user inputting the character set related to the diseaseIdentified as a set of characters that are highly likely to be selected by a user for searching.

Fig. 7 illustrates a state in which the electronic device selects a search category in consideration of the contents of a sentence.

According to the embodiment, the electronic device 10 may use the content of a sentence including characters selected by the user in a state of searching in the web browser by using the recognized character set. The electronic device 10 may determine a search category in the sentence that includes the user-selected character based on the meaning of the recognized character set and other words. In this case, other words used to determine the search category may be determined based on, for example, affinity with the recognized character set, type of part of speech, importance in the sentence, and so forth. Further, the electronic device 10 may determine the search category in consideration of contents of neighboring sentences of the sentence including the character selected by the user.

For example, the electronic device 10 may respond to a user selectionIn (1)(which is the word included in the first sentence) willIdentified as a character set that is highly likely to be selected by the user. When a user requests a searchThe electronic device 10 may perform a search through a web browser. In this case, the electronic device 10 may first include in the first sentence by reference such asOrTo search in categories related to books or novels for the scope of the search.

According to the embodimentThe electronic device 10 may respond to a user selectionIn (1)(as words included in the second sentence), recognizingAs a character set that is highly likely to be selected by the user. When a user requests a searchThe electronic device 10 may perform a search through a web browser. In this case, the electronic device 10 may first include in the second sentence by reference such asOrTo search in a category related to amusement parks for the search scope.

According to an embodiment, the electronic device 10 may respond to a user selectionIs/are as follows(which is the word included in the third sentence) willOther than the set of characters that are highly likely to be selected by the user. When a user requests a searchThe electronic device 10 may perform a search through a web browser. In this case, the electronic device 10 may first passReferences included in the second sentence such as Such words are searched for in categories related to movies for the scope of the search.

In this way, according to an embodiment of the present disclosure, the electronic device 10 may provide a search result suitable for the user's intention in consideration of the content of a sentence in which the character set is located.

Fig. 8 illustrates an embodiment in which an electronic device displays a selected region notification object according to an embodiment.

Referring to reference numeral 8-a of fig. 8, the electronic device 10 may display characters on the display 11. For example, the characters may be part of a newspaper article displayed on a web browser. However, the characters are not limited to newspaper articles, and may include various contents using the characters.

According to an embodiment, the electronic device 10 may receive a user input 805 to select at least one of the characters displayed on the display 11.

According to an embodiment, the user may select at least one character to conduct an additional search for a specific word, a specific phrase, a specific clause, or a specific sentence included in the article displayed on the display 11. For example, the electronic device 10 may receive user touch input to select a word displayed on the display 11810 of812。

Referring to reference numeral 8-b of fig. 8, the electronic apparatus 10 may obtain a plurality of character sets by repeating an operation of obtaining a plurality of characters including the selected character as one character set in response to the user selection.

For example, electronic device 10 may be obtained as comprising812 of the sentence Wherein812 is a character selected by the user. The electronic device 10 may be obtained comprising812 as a character set.

For example, the electronic device 10 may obtainAs a first character set candidate. Further, the electronic device 10 may obtainAs a second character set candidate and obtainingAs a third character set candidate.

According to an embodiment, the electronic device 10 may display character set candidates on the display 11 and identify one of the character set candidates as a character set on which the user performs an additional information search based on the user selection.

For example, the electronic device 10 may display a candidate list including the first to third character set candidates in the form of a pop-up window 820 on the display 11. The electronic device 10 may display the selected character set to distinguish from other characters according to a user input for selecting one of the displayed character set candidates.

Fig. 9 is a block diagram of an electronic device according to various embodiments.

Referring to fig. 9, the electronic device 901 may include a character/location selection module 910, a candidate selection module 912, a candidate scoring/reordering module 914, a boundary generation module 916, a previous device/previous user configuration 918, a search history database 920, and a keyword dictionary 922. Electronic device 901 may comprise electronic device 10 of fig. 1A.

According to an embodiment, the character/location selection module 910 may receive user input to select a character from a sentence. The character/position selection module 910 may obtain the position of the selected character in the sentence or the relative position in the sentence.

According to an embodiment, the candidate selection module 912 may obtain a character set including the selected character and at least one neighboring character. The candidate selection module 912 may obtain multiple character sets by repeatedly performing this process.

According to an embodiment, the candidate scoring/reordering module 914 may obtain a plurality of candidate sentences each corresponding to the obtained character set, and analyze the obtained candidate sentences. For example, the candidate scoring/reordering module 914 may analyze the meaning of the candidate sentences and give a consistency score.

According to various embodiments, the candidate scoring/reordering module 914 may send the obtained results to the candidate selection module 912. The candidate selection module 912 may perform a process of obtaining a plurality of characters including the selected character as one character set again by reflecting the transmitted result.

According to an embodiment, the candidate selection module 912 and the candidate scoring/re-ranking module 914 may use data received from the search history database 920 and the keyword dictionary 922 when performing the above-described operations.

For example, the search history database 920 may store a search history for a user to search using the electronic apparatus 901. When performing the operation of obtaining and identifying a character set, the candidate selection module 912 and the candidate scoring/reordering module 914 may assign weights to character sets related to fields that are of general interest to the user of the electronic device 901 by referring to the search history received from the search history database 920.

Further, keyword dictionary 922 may store general scores for a character set. When performing the operations of obtaining and recognizing character sets, the candidate selection module 912 and the candidate scoring/reordering module 914 may weight less frequently used but significant character sets by referencing the general scores received from the keyword dictionary 922.

Previous device/previous user configuration 918 may store basic information of electronic device 901. The basic information may include, for example, memory capacity, CPU power, display size, etc. of the electronic device 901. The electronic device 10 may adjust the amount of data stored in the search history database 920 and the keyword dictionary 922 according to the basic information. Alternatively, when transferring the continuity score to the character set, the electronic device 10 may adjust the data range for using the data stored in the search history database 920 and the keyword dictionary 922 according to the basic information.

According to various embodiments, the electronic device 901 may receive and use data from an external device. For example, the electronic apparatus 901 may receive a specific search history used by a plurality of users from the general search history database 930 and use the specific search history when giving a consistency score to a character set.

Alternatively, the electronic apparatus 901 may receive the general score from the general keyword dictionary 940 and use the general score when giving the consistency score to the character set.

According to various embodiments, the character/location selection module 910, the candidate selection module 912, the candidate scoring/reordering module 914, and the boundary generation module 916 may be terms that relate to constituent elements that perform at least one function or operation. Accordingly, these constituent elements may be stored in a memory (e.g., memory 230 of fig. 2) or implemented by a processor (e.g., processor 210 of fig. 2) in the form of a combination of software or a combination of instructions.

According to various embodiments, prior device/prior user configuration 918, search history database 920, and keyword dictionary 922 may correspond to memory 230 of fig. 2.

According to various embodiments, the general search history database 930 and the general keyword dictionary 940 may correspond to at least one server that establishes communication with the electronic apparatus 901.

The AI-related functions according to the present disclosure may be operated by a processor and a memory. The processor may include one or more processors. In this state, the one or more processors may include a general-purpose processor such as a Central Processing Unit (CPU), an Application Processor (AP), a Digital Signal Processor (DSP), or the like, a graphics-dedicated processor such as a Graphics Processing Unit (GPU) or a Visual Processing Unit (VPU), or an AI-dedicated processor such as a Neural Processing Unit (NPU). The one or more processors may be controlled to process the input data according to predetermined operating rules or AI models stored in memory. Alternatively, when one or more processors are AI-specific processors, the AI-specific processors can be designed with a hardware architecture that is dedicated to processing a particular AI model.

The predefined operating rules or AI models are formed characteristically by learning. What is formed by learning may mean: the predefined operating rules or AI models configured to perform the desired features or objectives are formed as the base AI model is trained through a learning algorithm using a plurality of learning data. The learning may be performed in the device itself, where the AI according to the present disclosure is performed, or by a separate server and/or system. Examples of learning algorithms may include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but are not limited to the above examples.

The AI model may include a plurality of neural network layers. Each of the plurality of neural network layers may have a plurality of weight values, and the neural network operation is performed by an operation between an operation result of a previous layer and the plurality of weight values. The weight values of the neural network layers can be optimized by the learning result of the AI model. For example, a plurality of weight values may be updated to reduce or reduce the loss or cost values obtained by the AI model during the learning process. The artificial intelligence neural network may include a Deep Neural Network (DNN), such as a Convolutional Neural Network (CNN), a Deep Neural Network (DNN), a Recurrent Neural Network (RNN), a constrained Boltzmann machine (RBM), a Deep Belief Network (DBN), a bi-directional recurrent deep neural network (BRDNN), a deep Q network, and so forth, although the disclosure is not limited thereto.

According to an embodiment, at least one AI model, such as a coherence recognition model, a general recognition model, or a sentence analysis model, may be trained.

For example, when multiple sentences are input to the AI model, the AI model may be trained to estimate words that occur next to a set of consecutive words that make up each of the multiple sentences.

For example, continuous phrases and words adjacent to each phrase are extracted from an arbitrary sentence, and the extracted phrases and words may be used as training data. Thus, the AI model may estimate how natural a sentence is, such as a consistency score or a generality score.

Further, according to various embodiments, when a plurality of sentences are input to the AI model, the AI model may be trained to estimate a plurality of words located at a predetermined distance from each word constituting the plurality of sentences. Further, when a plurality of sentences are input to the AI model, the AI model may be trained to estimate one word located at the same distance from the words constituting the plurality of sentences.

For example, a plurality of words located at a predetermined distance from one word included in a sentence may be extracted from a certain sentence, and the extracted words may be used as training data. Further, one word located at the same distance from a plurality of words may be extracted from a certain sentence, and the extracted word may be used as training data.

The inherent directionality of each word can be obtained by using the trained results, and the similarity of words (e.g., a continuity score or a generality score) can be estimated by using the directionality.

Further, according to various embodiments, when multiple sentences and their corresponding sentence structures are input to the AI model, the AI model may be trained to estimate the sentence structures that make up the multiple sentences.

According to various embodiments, a consistency recognition model may be trained such that the consistency recognition model has a criterion of identifying a consistency score for a set of characters included in a sentence or document. The consistency recognition model may be trained to have criteria on which training data is used for the consistency recognition model to obtain a consistency score for a set of characters included in a sentence or document, or how to identify a consistency score for a set of characters included in a sentence or document by using the training data.

According to various embodiments, the consistency recognition model may be trained by using multiple sentences or multiple documents as training data. For example, the training data may include all types of documents and sentences, such as newspaper articles, editorial, novels, treatises, and the like.

According to various embodiments, a trained coherence recognition model may obtain a coherence score for a set of characters included in a sentence or document based on various types of recognition data. The trained consistency recognition model may obtain a consistency score for the character set from the at least one sentence or document that is input.

According to various embodiments, a user's response or feedback to the coherence score output from the coherence recognition model may be used to update the coherence recognition model. Thus, the consistency recognition model may increase the probability of obtaining a consistency score for a character set according to the user's treatment.

According to various embodiments, a generic recognition model may be trained with criteria to obtain a generic score for a set of characters included in a sentence or document. The general recognition model may be trained to have criteria as to which training data is used to obtain a general score for the set of characters included in the sentence or document, or how the continuity scores for the set of characters included in the sentence or document are recognized by using the training data.

According to various embodiments, a generic recognition model may be trained by using multiple sentences or multiple documents as training data. For example, the training data may include sentences and documents of all types, such as newspaper articles, editorial, novels, treatises, and the like.

According to various embodiments, a trained generic recognition model may obtain a generic score for a set of characters included in a sentence or document based on various types of recognition data. The trained generalized recognition model may obtain a generalized score for a character set from at least one sentence or document of the input.

According to various embodiments, a user's response to a generic score output from a generic recognition model may be used to update the generic recognition model. Thus, the generic recognition model may increase the probability of obtaining a generic score for a character set according to the user's treatment.

According to various embodiments, a sentence analysis model may be trained to have criteria for classifying constituent elements (e.g., nouns, verbs, suffixes, postwords, etc.) included in a sentence. The sentence analysis model may be trained to have a criterion as to which training data is used to classify constituent elements included in the sentence, or how to identify constituent elements included in the sentence by using the training data.

According to various embodiments, a sentence analysis model may be trained by using a result of classifying sentences and words included in the sentences using training data according to the constituent elements.

For example, a sentence analysis model may be trained by using the following results: for sentencesThe classification results are used to train a sentence analysis model, wherein,is the noun,Is a pronoun,Is the noun,Is a postword, andis a verb.

According to various embodiments, the trained sentence analysis model may classify constituent elements included in a sentence based on various types of recognition data. At least one constituent element included in the input sentence may be classified by using a trained sentence analysis model.

According to various embodiments, the user's response to the results output from the sentence analysis model may be used to update the sentence analysis model.

For example, when a sentence is inputThe sentence analysis model can obtain the pronounsAs postwordsAnd as adjectivesThe classification result of (1).

The coherent recognition model, the general recognition model, and the sentence analysis model may be established in consideration of the application field of the recognition model, the purpose of learning, the computer performance of the apparatus, and the like. The consistency recognition model, the general recognition model, and the sentence analysis model may be models based on, for example, a neural network. The consistency recognition model, the general recognition model, and the sentence analysis model may include, for example, a neural network model or a deep learning model developed from the neural network model.

Fig. 10 is a flowchart of an electronic device recognizing and displaying a state of a plurality of characters according to an embodiment.

In operation 1110, the electronic device 10 may display at least one sentence.

For example, the electronic device 10 may display a newspaper article displayed on a web browser on the display 220.

In operation 1120, when a user input selecting at least one character included in a sentence is received, the electronic device 10 may analyze the sentence by using the at least one character and the sentence including the at least one character.

For example, when the display 220 comprises a touch screen display, the electronic device 10 may receive user input for selecting characters by touch of an area of the touch screen display.

For example, in response to a user selection, the electronic device 10 may obtain a character set that includes the selected character and at least one adjacent character. The electronic device 10 may obtain a plurality of character set candidates by repeatedly performing the operation of obtaining the character set.

The electronic device 10 may obtain a plurality of candidate sentences respectively corresponding to the plurality of character set candidates, and may analyze the obtained candidate sentences.

For example, the electronic device 10 may obtain the continuity score of the character set candidate by analyzing the obtained candidate sentence. The consistency score as a result of analyzing the candidate sentence may be a score given to the character set. For example, the coherence score may be a score calculated and given by the electronic device 10 based on how coherent the character set has with other characters in the sentence.

According to various embodiments, the electronic device 10 may generate a new character set candidate by combining the obtained character set with another character in the process of obtaining one character set of the plurality of character set candidates.

In operation 1130, the electronic device 10 may select a character set included in the sentence according to the analysis result. One character set selected by the electronic device 10 is, for example, an analysis result of a candidate sentence, which may be a character set having a high consistency score.

In operation 1140, the electronic device 10 may display the selected character set separately from other characters included in the sentence.

For example, the electronic device 10 may change and display the color of the area adjacent to the recognized character set.

Fig. 11 is a flow diagram of a state in which an electronic device according to an embodiment is associated with a server to recognize and display a plurality of characters.

In operation 1210, the electronic device 10 may display at least one sentence.

In operation 1220, the electronic device 10 may obtain a sentence including at least one character when a user input regarding at least one character of the displayed sentence is received.

In operation 1230, the electronic device 10 may transmit the at least one character and the sentence including the at least one character to the server 20.

In operation 1240, the server 20 may analyze the sentence by using the at least one character and the sentence including the at least one character. In operation 1250, the server 20 may select a character set included in the sentence according to the analysis result. For example, server 20 may obtain a plurality of character set candidates including a character selected corresponding to a user input, obtain a plurality of candidate sentences corresponding to the obtained character sets, and select one character set by analyzing the obtained candidate sentences.

In operation 1260, the server 20 may transmit the selected character set to the electronic device 10.

In operation 1270, the electronic device 10 may display the received character set separately from other characters included in the sentence.

According to various embodiments, when the server 20 is connected to the electronic device 10 and controls the display 220 of the electronic device 10 to display characters, the server 20 may recognize a sentence including at least one character in response to a user input of the at least one character. In this case, according to the analysis result, the server 20 may control the display 220 of the electronic device 10 to display the character set included in the sentence to be distinguished from other characters included in the sentence.

Fig. 12 is a block diagram of an electronic device 1301 in a network environment 1300, according to various embodiments. The electronic device 1301 may include the electronic device 10 of fig. 1A. Referring to fig. 12, in a network environment 1300, an electronic device 1301 may communicate with an electronic device 1302 via a first network 1398 (e.g., a short-range wireless communication network) or with an electronic device 1304 or a server 1308 via a second network 1399 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 1301 may communicate with the electronic device 1304 via the server 1308. According to an embodiment, the electronic device 1301 may include a processor 1320, a memory 1330, an input device 1350, a sound output device 1355, a display device 1360, an audio module 1370, a sensor module 1376, an interface 1377, a haptic module 1379, a camera module 1380, a power management module 1388, a battery 1389, a communication module 1390, a user identification module 1396, or an antenna module 1397. In an embodiment, in the electronic device 1301, at least one of the above-described constituent elements, such as the display device 1360 or the camera module 1380, may be omitted, or one or more other constituent elements may be added. In an embodiment, some constituent elements may be implemented as one integrated circuit. For example, the sensor module 1376 (e.g., fingerprint sensor, iris sensor, or illuminance sensor) may be implemented by being embedded in the display device 1360 (e.g., display)

The processor 1320 may control at least one of other constituent elements of the electronic device 1301, such as hardware or software constituent elements, connected to the processor 1320, and perform various data processing or operations by executing software, such as the program 1340, for example. According to an embodiment, as at least part of data processing or operation, processor 1320 may load instructions or data received from other components (e.g., sensor module 1376 or communication module 1390) onto volatile memory 1332, process the instructions or data stored in volatile memory 1332, and store the resulting data in non-volatile memory 1334. According to an embodiment, the processor 1320 may include a main processor 1321 (e.g., a central processing device or an application processor) and an auxiliary processor 1323 (e.g., a graphics processing device, an image signal processor, a sensor hub processor, or a communications processor), which may operate independently or entirely. Additionally or alternatively, secondary processor 1323 may be configured to use less power than primary processor 1321, or be assigned to a designated function. Secondary processor 1323 may be implemented separately from primary processor 1321 or as part of primary processor 1321.

The auxiliary processor 1323 may control at least some of the functions or states associated with at least one of the constituent elements of the electronic device 1301, such as the display device 1360, the sensor module 1376, or the communication module 1390, if the main processor 1321 is in an inactive state (e.g., a sleep state), or control at least some of the functions or states associated with at least one of the constituent elements of the electronic device 1301 together with the main processor 1321, if the main processor 1321 is in an active state (e.g., an application execution state). According to an embodiment, the auxiliary processor 1323 (e.g., an image signal processor or a communication processor) may be implemented as part of other function-related constituent elements (e.g., the camera module 1380 or the communication module 1390).

The memory 1330 may store various data used by at least one component of the electronic device 1301 (e.g., the processor 1320 or the sensor module 1376). The data may include, for example, software such as program 1340, as well as input data or output data regarding instructions associated therewith. Memory 1330 may include volatile memory 1332 or non-volatile memory 1334.

The programs 1340 may be stored as software in the memory 1330, and may include, for example, an operating system 1342, middleware 1344, or applications 1346.

The input device 1350 may receive instructions or data for the constituent elements of the electronic device 1301 (e.g., the processor 1320) from outside the electronic device 1301 (e.g., from a user). Input device 1350 may include, for example, a microphone, a mouse, or a keyboard.

The sound output device 1355 may output a sound signal to the outside of the electronic device 1301. The acoustic output device 1355 may include, for example, a speaker or a receiver. The speaker may be used for general purposes such as multimedia reproduction or record reproduction, and the receiver may be used to receive an incoming call. Depending on the embodiment, the receiver may be implemented separately from the speaker or as part of the speaker.

The display device 1360 may visually provide information to the outside of the electronic device 1301, such as to provide information to a user. The display device 1360 may include, for example, a display, a hologram device, or a projector, and control circuitry for controlling any of the devices. According to an embodiment, the display device 1360 may include touch circuitry configured to sense touch, or sensor circuitry configured to measure the intensity of force generated by touch, such as a pressure sensor.

The audio module 1370 may convert sound into an electrical signal or inversely convert the electrical signal into sound. According to embodiments, the audio module 1370 may obtain sound through the input device 1350 or output sound by directly or wirelessly connecting to the electronic device 1301 through the sound output device 1355 or an external electronic device (e.g., the electronic device 1302 such as a speaker or an earphone).

The sensor module 1376 may detect an operating state of the electronic device 1301, such as power or temperature, or an external environment state, such as a user state, and generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 1376 may include, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an Infrared (IR) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 1377 may support one or more specified protocols for the electronic device 1301 to connect directly or wirelessly to an external electronic device (e.g., the electronic device 1302). According to an embodiment, the interface 1377 may include, for example, a High Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB) interface, an SD card interface, or an audio interface.

Connection end 1378 may include a connector by which electronic device 1301 physically connects to an external electronic device, such as electronic device 1302. According to an embodiment, the connection terminal 1378 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector, such as a headphone connector.

The haptic module 1379 may convert the electrical signal into a mechanical stimulus, such as vibration or motion, which may be recognized by a user through a tactile or motor sensation, or into an electrical stimulus. According to embodiments, the haptic module 1379 may include, for example, a motor, a piezoelectric device, or an electrical stimulation device.

The camera module 1380 may capture still images and video. According to an embodiment, the camera module 1380 may include one or more lenses, an image sensor, an image signal processor, or a flash.

The power management module 1388 may manage power provided to the electronic device 1301. According to an embodiment, the power management module 1388 may be implemented as at least a portion of a Power Management Integrated Circuit (PMIC), for example.

The battery 1389 may provide electrical power to at least one constituent element of the electronic device 1301. According to an embodiment, the battery 1389 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

The communication module 1390 may establish a direct communication channel (e.g., a wired communication channel) or a wireless communication channel between the electronic device 1301 and an external electronic device (e.g., the electronic device 1302, the electronic device 1304, or the server 1308) and support communication through the established communication channel. The communication module 1390 may include one or more communication processors, such as an application processor, that operate independently of the processor 1320 and support direct communication, such as wired or wireless communication. According to an embodiment, the communication module 1390 may include a wireless communication module 1392, such as a cellular communication module, a short-range wireless communication module, or a Global Navigation Satellite System (GNSS) communication module, or may include a wired communication module 1394, such as a LAN communication module or a power line communication module. Any respective one of the communication modules may communicate with external electronic devices over a first network 1398 (e.g., a short-range communication network such as bluetooth, WiFi direct or infrared data association (IrDA)) or a second network 1399 (e.g., a long-range communication network such as a cellular network, the internet, or a computer network such as a LAN or WAN). These various types of communication modules may be implemented by being integrated into one constituent element, such as a single chip, or implemented as a plurality of separate constituent elements, such as a plurality of chips. The wireless communication module 1392 may check and approve the electronic device 1301 in a communication network, such as the first network 1398 or the second network 1399, by using subscriber information (e.g., International Mobile Subscriber Identity (IMSI)) stored in the subscriber identity module 1396.

The antenna module 1397 may transmit signals or power to or receive signals or power from the outside, such as an external electronic device. According to an embodiment, the antenna module 1397 may include one or more antennas, and wherein at least one antenna suitable for a communication method used for a communication network, such as the first network 1398 or the second network 1399, may be selected by the communication module 1390, for example. Signals or power may be transmitted or received between the communication module 1390 and external electronic devices through the selected at least one antenna.

At least some constituent elements may be connected to each other by a communication method between peripheral devices, such as a bus, a General Purpose Input and Output (GPIO), a Serial Peripheral Interface (SPI), or a Mobile Industrial Processor Interface (MIPI), and exchange signals (e.g., instructions or data) therebetween.

According to an embodiment, instructions or data may be sent or received between the external electronic device 1301 and the electronic device 1304 via a server 1308 connected to the second network 1399. The electronic devices 1302 and 1304 may each be the same or different device than the electronic device 1301. The server 1308 may include a communication module (not shown), a processor (not shown), and a memory (not shown). However, the present disclosure is not limited thereto, and the server 1308 may further include constituent elements or omit some constituent elements. Server 1308 may include server 20 of fig. 11. According to an embodiment, all or some of the operations performed in the electronic device 1301 may be performed in one or more external devices, such as the electronic devices 1302 and 1304 or the server 1308. For example, when the electronic device 1301 is assumed to automatically perform a function or service, or to perform a function or service in response to a request from a user or another device, the electronic device 1301 may not perform the function or service but request one or more external electronic devices to perform at least a part of the function or service, or may request one or more external electronic devices to perform at least a part of the function or service in addition to performing the function or service. The external electronic device or devices that have received the request may perform at least a part of the requested function or service or perform an additional function or service related to the request and transmit the result of the execution to the electronic device 1301. The electronic device 1301 may process the results as is or in addition and provide the results as at least part of a response to the request.

Alternatively, the electronic apparatus 1301 may transmit the at least one character and the sentence including the at least one character designated by the user selection to the server 1308, and receive a result of selecting the character set included in the sentence by analyzing the sentence using the at least one character and the sentence including the at least one character received by the server 1308. To this end, for example, cloud computing, distributed computing, or client-server computing techniques may be used.

Various embodiments of the disclosure may be implemented as software (e.g., program 1340) including one or more instructions stored in a storage medium, such as internal memory 1336 or external memory 1338, which may be read by a machine (e.g., electronic device 1301). For example, a processor (e.g., processor 1320) of an apparatus (e.g., electronic apparatus 1301) may retrieve and execute at least one of the one or more instructions stored in the storage medium. This enables the apparatus to perform at least one function according to the retrieved at least one instruction. The one or more instructions may include code generated by a compiler or code that may be executed by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. "non-transitory" may mean that the storage medium is a tangible device and does not include a signal such as an electromagnetic wave, and the term does not distinguish between a case where data is semi-permanently stored in the storage medium and a case where the data is temporarily stored.

According to an embodiment, a method according to various embodiments disclosed in the present disclosure may be provided by being included in a computer program product. The computer program product is a product of a transaction between a seller and a buyer. The computer program product may be distributed in the form of a device-readable storage medium, e.g. a compact disc read-only memoryMemory (CD-ROM), or by using memory (e.g. PlayStore)^TM) Or distributed, e.g., downloaded or uploaded, directly or online between two user devices (e.g., smartphones). For online distribution, at least a portion of the computer program product may be at least temporarily stored in or temporarily generated from a device-readable storage medium, such as a memory of a manufacturer's server, a server of an application store, or a relay server.

According to various embodiments, each of the above-described constituent elements, such as modules or programs, may include a single or a plurality of objects. According to various embodiments, among the above-described constituent elements, one or more constituent elements or operations may be omitted, or one or more other constituent elements or operations may be added. Alternatively or additionally, a plurality of constituent elements (e.g., modules or programs) may be integrated into one constituent element. In this case, the integrated constituent element may perform one or more functions of each constituent element in the same or similar manner as one or more functions performed by the constituent element of the constituent element before integration. Operations performed by a module, program, or other component element may be performed sequentially, in parallel, repeatedly, or heuristically, one or more operations may be performed in another or omitted, or one or more other operations may be added, according to various embodiments.