阅读说明：本技术 信息处理装置及计算机可读介质 (Information processing apparatus and computer readable medium ) 是由 斋田堂好 于 2020-09-07 设计创作，主要内容包括：本发明提供信息处理装置及计算机可读介质。信息处理装置具有能够开闭的显示机构和处理器,该显示机构在闭状态下在第1显示区域显示第1画面,在开状态下在具有比所述第1显示区域大的面积的第2显示区域显示第2画面,所述处理器在所述闭状态的所述显示机构变化为所述开状态时,执行使所述第2画面的可见性降低的显示处理。(The invention provides an information processing apparatus and a computer readable medium. The information processing apparatus includes an openable and closable display unit that displays a 1 st screen in a 1 st display region in a closed state and a 2 nd screen in a 2 nd display region having a larger area than the 1 st display region in an open state, and a processor that executes a display process for reducing visibility of the 2 nd screen when the display unit in the closed state changes to the open state.)

1. An information processing apparatus, wherein,

the information processing apparatus includes:

an openable/closable display mechanism that displays a 1 st screen in a 1 st display region in a closed state and displays a 2 nd screen in a 2 nd display region having a larger area than the 1 st display region in an open state; and

a processor for processing the received data, wherein the processor is used for processing the received data,

the processor executes display processing for reducing visibility of the 2 nd screen when the display mechanism in the closed state changes to the open state.

2. The information processing apparatus according to claim 1,

when the display means for displaying 1 st display content on the 1 st screen in the closed state changes to the open state, the processor controls the display means so that 2 nd display content including the 1 st display content is displayed on the 2 nd screen,

the display processing for reducing the visibility is processing for reducing the visibility of the 2 nd display content displayed on the 2 nd screen.

3. The information processing apparatus according to claim 2,

the display processing for reducing the visibility is processing for displaying a 1 st image for reducing the visibility in a manner to be superimposed on the 2 nd display content displayed on the 2 nd screen.

4. The information processing apparatus according to claim 3,

the 1 st image is a translucent image.

5. The information processing apparatus according to claim 4,

the processor recognizes a touch operation performed by a user on a screen on which the 1 st image is superimposed and displayed as an operation on a place to be a subject of the touch operation in the 2 nd display content viewed through the 1 st image.

6. The information processing apparatus according to any one of claims 3 to 5,

the setting of the display state of the 1 st image is accepted by the operation for the 1 st image.

7. The information processing apparatus according to any one of claims 3 to 6,

and controlling the display of the 1 st image according to the 2 nd display content.

8. The information processing apparatus according to any one of claims 1 to 7,

it is possible to set a condition for executing the display processing for reducing the visibility,

when the display mechanism in the closed state changes to the open state, if the condition is satisfied, the display processing for reducing the visibility is executed, and if the condition is not satisfied, the display processing for reducing the visibility is not executed.

9. The information processing apparatus according to claim 8,

the processor receives a setting for validation or invalidation of the display processing for reducing the visibility from a user,

when the display processing for reducing the visibility is set to be invalidated, the display processing for reducing the visibility is not executed even if the condition is satisfied.

10. The information processing apparatus according to claim 8,

the processor executes a predetermined warning process when the condition is satisfied in a case where the display process for reducing the visibility is set to be invalidated.

11. A computer-readable medium storing a program for causing a computer to execute a process, the computer having an openable and closable display mechanism for displaying a 1 st screen in a 1 st display region in a closed state and displaying a 2 nd screen in a 2 nd display region having an area larger than that of the 1 st display region in an open state,

the processing includes display processing for reducing visibility of the 2 nd screen when the display mechanism in the closed state changes to the open state.

Technical Field

The present disclosure relates to an information processing apparatus and a computer readable medium.

Background

Flexible displays using organic EL (electroluminescence), electronic paper, and the like are being developed. In recent years, a structure of a flexible display mounted on a portable terminal has been proposed (japanese patent application publication No. 2017-510065, european patent application publication No. 003352044, international publication No. 2018/192426), and a portable terminal having such a structure is being sold.

A smart phone that is folded in half and that is equipped with a flexible display can be, for example, as wide as one hand when closed, and can display a large screen comparable to a tablet terminal when opened. In some of such smartphones, a screen having an area smaller than that of the opened state can be displayed even in the closed state. For example, some types of smart phones that fold a large screen of a main display inward have a sub-display smaller than a surface located on the outer side in a closed state. In some models of smart phones that fold the large screen of the main display outward, the main display is folded in half and displayed on the half facing the user in the closed state. In addition, these types of smart phones interlock screen display between a closed state and an open state. For example, when a large screen is opened, these smartphones display the same application screen on the large screen as an application screen displayed on a small screen in a closed state.

Further, in the device described in japanese patent application laid-open No. 2017-130158, a user interface (hereinafter, referred to as UI) screen is displayed on the entire surface of the touch panel in a state where the foldable touch panel is opened in a flat state. Further, in a state where the touch panel is bent to a certain angle, a soft keyboard is displayed on a half surface of the touch panel and a UI screen is displayed on the remaining half surface, providing usability similar to that of a notebook PC.

Disclosure of Invention

When the display means in the closed state is in the open state, a large image is suddenly displayed on a large screen, and therefore, the risk of information leakage due to peeping by a third person becomes greater than that of a device with a small screen. For example, when the display means changes from the closed state to the open state to display the application screen displayed on the small screen in the closed state on the large screen in the open state, the application screen is displayed larger than that on the small screen, or an item not displayed on the small screen is displayed.

An object of the present disclosure is to provide an information processing apparatus capable of reducing the degree of leakage of display content of a 2 nd screen when a display mechanism is changed from a closed state to an open state, as compared with directly displaying a 2 nd screen to be displayed in the open state.

According to the 1 st aspect of the present disclosure, there is provided an information processing apparatus, wherein the information processing apparatus has: an openable/closable display mechanism that displays a 1 st screen in a 1 st display region in a closed state and displays a 2 nd screen in a 2 nd display region having a larger area than the 1 st display region in an open state; and a processor that executes display processing for reducing visibility of the 2 nd screen when the display mechanism in the closed state changes to the open state.

According to claim 2 of the present disclosure, when the display means for displaying the 1 st display content on the 1 st screen in the closed state changes to the open state, the processor controls the display means so that the 2 nd display content including the 1 st display content is displayed on the 2 nd screen, and the display processing for reducing the visibility is processing for reducing the visibility of the 2 nd display content displayed on the 2 nd screen.

According to the 3 rd aspect of the present disclosure, the display processing of reducing the visibility is processing of displaying a 1 st image of reducing the visibility in superimposition on the 2 nd display content displayed on the 2 nd screen.

According to the 4 th aspect of the present disclosure, the 1 st image is a translucent image.

According to the 5 th aspect of the present disclosure, the processor recognizes a touch operation performed by a user on a screen on which the 1 st image is superimposed and displayed as an operation on a place to be a subject of the touch operation in the 2 nd display content viewed through the 1 st image.

According to the 6 th aspect of the present disclosure, the setting of the display state of the 1 st image is accepted by the operation on the 1 st image.

According to the 7 th aspect of the present disclosure, the display of the 1 st image is controlled in accordance with the 2 nd display content.

According to the 8 th aspect of the present disclosure, it is possible to set a condition for executing the display processing for reducing the visibility, and when the display mechanism in the closed state changes to the open state, if the condition is satisfied, the display processing for reducing the visibility is executed, and if the condition is not satisfied, the display processing for reducing the visibility is not executed.

According to the 9 th aspect of the present disclosure, the processor accepts a setting for making the visibility-reduced display process valid or invalid from a user, and when the visibility-reduced display process is set to be invalid, the processor does not execute the visibility-reduced display process even if the condition is satisfied.

According to the 10 th aspect of the present disclosure, the processor executes a prescribed warning process when the condition is satisfied in a case where the display process that reduces the visibility is set to be invalidated.

According to an 11 th aspect of the present disclosure, there is provided a computer-readable medium storing a program for causing a computer having a display mechanism capable of opening and closing, the display mechanism displaying a 1 st screen in a 1 st display region in a closed state and displaying a 2 nd screen in a 2 nd display region having a larger area than the 1 st display region in an open state, to execute a process including a display process of reducing visibility of the 2 nd screen when the display mechanism in the closed state changes to the open state.

(Effect)

According to the aspects 1 to 3 or 11, when the display means is changed from the closed state to the open state, the degree of leakage of the display content of the 2 nd screen can be reduced as compared with the case where the 2 nd screen to be displayed in the open state is directly displayed.

According to the 4 th aspect, it is possible to reduce leakage of the 2 nd display content of the 2 nd screen and to enable the user operating the information processing apparatus to see the 2 nd display content.

According to the 5 th aspect, a touch operation of the user on the 2 nd display content located below the 1 st image can be accepted.

According to the 6 th aspect, it is possible to eliminate labor and time for setting a special user interface for setting the display state of the 1 st image separately from the 1 st image.

According to the 7 th aspect, an image corresponding to the 2 nd display content can be superimposed as the 1 st image.

According to the 8 th aspect, whether or not to execute the display processing that reduces visibility can be controlled by the set conditions.

According to the above-described aspect 9, the set condition can be maintained by setting with one touch, and even if the condition is satisfied, the display processing for reducing the visibility is not performed.

According to the aspect 10, even if the display processing for reducing visibility is invalidated, if the set condition is satisfied, the user can be warned of the fact.

Drawings

Fig. 1 is a diagram for explaining conventional display control of a foldable information processing device.

Fig. 2 is a diagram showing an example of a hardware configuration of the information processing apparatus.

Fig. 3 is a diagram for explaining display control of the foldable information processing apparatus according to the embodiment.

Fig. 4 is a diagram illustrating a setting screen for setting display of a mask image.

Fig. 5 is a diagram illustrating a processing procedure performed by the information processing apparatus.

Fig. 6 is a diagram illustrating a mask image including a UI (user interface) for display setting.

Fig. 7 is a diagram illustrating an occlusion image reduced in size and fixed in position.

Fig. 8 is a diagram for explaining an example of controlling an occlusion image according to the display content of each region of the screen.

Fig. 9 is a diagram illustrating a screen display including an icon that receives an instruction to switch between a mode for receiving an operation on a mask image and a mode for receiving an operation on a screen below the mask image.

Detailed Description

An example of conventional display control of a foldable information processing apparatus 10 having a large-screen flexible display and folded in half will be described with reference to fig. 1. The information processing device 10 is, for example, a portable information terminal (for example, a smartphone or a tablet terminal), but is not limited thereto.

The information processing apparatus 10 illustrated in fig. 1 includes a 1 st body 12A and a 2 nd body 12B openably and closably coupled to each other. On one surface of the 1 st body 12A and one surface of the 2 nd body 12B, a flexible main display 14 is provided so as to span both. The main display 14 has a display region having an area close to the total area of the surfaces of both the 1 st body 12A and the 2 nd body 12B. In this example, the sub-display 16 is provided on the surface of the 1 st body 12A on which the main display 14 is not provided. The sub-display 16 is housed in the surface of the 1 st body 12A, and has a smaller display area than the main display 14. Further, the sub-display 16 may not be flexible. The main display 14 and the sub-display 16 are configured as touch panel displays, for example. In this example, a structure including the main display 14 and the sub-display 16, and the 1 st body 12A and the 2 nd body 12B supporting them corresponds to an openable and closable display mechanism.

In fig. 1, (a) the information processing device 10 in the closed state is shown on the left side, and (b) the information processing device 10 in the open state is shown on the right side.

The closed state is a state in which the display mechanism is closed to such an extent that the display area of the main display 14 cannot be seen from the outside. In the closed state, the display area of the main display 14 cannot be seen from the outside of the information processing apparatus 10, and instead, the display area of the sub display 16 can be seen. In the (a) closed state illustrated in the figure, the surfaces on the main display 14 side of the 1 st body 12A and the 2 nd body 12B are in contact with each other or are adjacent to each other to the extent of being in contact. In this state, the angle formed by the 1 st body 12A side and the 2 nd body 12B side surfaces of the main display 14 (i.e., the opening angle of the display mechanism) is substantially 0 degree. The case where the opening angle is substantially 0 degrees is defined as the closed state, which is only an example. Alternatively, a threshold value larger than 0 degree may be predetermined, and the closed state may be defined when the opening angle is in the range of 0 degree to the threshold value.

The on state is a state in which the display mechanism is opened to such an extent that the display area of the main display 14 can be seen. In the open state, the display area of the sub-display 16 cannot be seen from the outside of the information processing apparatus 10, and instead, the display area of the main display 14 can be seen. In the figure, the state in which the display mechanism is opened by 180 degrees is shown as the (b) open state as an example, but this is just an example. For example, a 2 nd threshold value smaller than 180 degrees may be determined in advance, and a case where the opening angle is within a range of the 2 nd threshold value to 180 degrees may be defined as the on state.

When the display mechanism is in the closed state, the information processing apparatus 10 displays a screen in the display area of the sub-display 16. In the closed state, the screen display in the display area of the main display 14 may be stopped. In contrast, when the display mechanism is in the on state, the information processing device 10 performs screen display in the display area of the main display 14. In the on state, the screen display in the display region of the sub-display 16 may be stopped.

The sub-display 16 is an example of a 1 st display region for displaying the 1 st screen in the closed state, and the main display 14 is an example of a 2 nd display region larger than the 1 st display region for displaying the 2 nd screen in the open state.

In the illustrated example, a screen 17 is displayed on the sub-display 16 in the closed state, and the screen 17 shows information of a certain contact address generated by the address book application. On this screen 17, information such as the name, address, and telephone number of the contact address, an icon 20 for calling out a telephone application, an icon 22 for calling out an email application, and the like are displayed. When the user turns on the display mechanism from this state to set the display mechanism to the on state, the information processing apparatus 10 starts the display of the main display 14. At this time, a screen 15 is displayed on the main display 14, and the screen 15 shows information for the same contact method for the same address book application as the screen 17 displayed in the closed state. Here, since the screen size of the display area of the main display 14 is larger than the screen size of the display area of the sub-display 16, the application program is configured to display more display contents on the screen 15 than on the screen 17. For example, in the screen 15, in addition to the display content displayed in the screen 17, an image 19 of a face photograph of a contact user, an icon 24 for calling up an SNS (social media network) application, and the like, which are not displayed in the screen 17, are displayed. The screen 15 of the application displayed on the main display 14 corresponds to the 1 st screen, and the image (for example, composed of a character string, an image of a face photograph, and an icon group) of the screen 15 corresponds to the 1 st display content displayed on the 1 st screen. The screen 17 displayed on the sub-display 16 corresponds to the 2 nd screen, and the image on the screen 17 corresponds to the 2 nd display content displayed on the 2 nd screen.

In this specification, an application is an application program executed by the information processing apparatus 10.

Fig. 2 shows an example of a main part of the hardware configuration of the information processing apparatus 10. The hardware configuration includes elements of a general computer such as a processor 102, a memory 104 such as a random access memory, an auxiliary storage device 106 such as a flash memory, a display control circuit 108, and an input control circuit 110. Further, the display device includes a communication circuit 112, a sensor 114 for detecting an open/close state of the display mechanism, and the like. In the illustrated example, the processor 102, the memory 104, the auxiliary memory 106, the display control circuit 108, the input control circuit 110, the communication circuit 112, and the sensor control circuit 115 that controls the sensor 114 are connected to a bus 120. The processor 102 exchanges data with the memory 104, the assist memory 106, the display control circuit 108, the input control circuit 110, the communication circuit 112, and the sensor control circuit 115 via the bus 120. In the example of fig. 2, all elements from the processor 102 to the sensor control circuit 115 are connected to the same bus 120 in a flat manner, but this is merely an example. Alternatively, the following hierarchy is also possible: some of these elements (for example, an element group including the processor 102) are integrated into one Chip, for example, like an SoC (System-on-a-Chip), and the remaining element groups are connected to an external bus to which the Chip is connected.

The processor 102 is a general-purpose processor (e.g., a Central Processing Unit (CPU), a professional processor (e.g., a GPU), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), a Programmable logic device (plc), etc.).

Further, the actions of the processor 102 may be performed not only by 1 processor but also by cooperation of a plurality of processors existing at physically separate locations. The operations of the processor 102 are not limited to the order described in the following embodiments, and may be changed as appropriate.

The display control circuit 108 controls the screen display of the main display 14 and the sub-display 16. The input control circuit 110 detects and processes a touch input to the touch panels of the main display 14 and the sub-display 16, and transmits the processing result to the processor. The communication circuit 112 performs signal processing for wireless or the like communication between the information processing apparatus 10 and an external network apparatus.

The sensor 114 for detecting the open/close state of the display mechanism may be a hall element, for example. In this case, a magnet is provided on one of the 1 st body 12A and the 2 nd body 12B, a hall element is provided on the other, and when the display means is closed and the magnet and the hall element are brought close to each other, the hall element detects magnetism, and it is detected that the display means is in the closed state. The sensor for detecting the open-closed state of the display mechanism is not limited to the hall element. As the sensor 114, various sensors conventionally used for detecting opening and closing of an openable and closable device, for example, various sensors such as an infrared sensor, an illuminance sensor, an acceleration sensor, a gyro sensor, and a proximity sensor, may be used.

The information processing device 10 may include an output device such as a speaker or a vibration mechanism.

In the conventional display control, when the display device in the closed state is configured to be in the open state, the screen 15 containing more information corresponding to the screen 17 displayed in the display area of the sub-display 16 in the closed state immediately before the screen 17 is displayed on the main display 14. However, in this case, when the user using the information processing device 10 views the display on the screen 17 in the closed state, the display content (for example, the image 19 of the face photograph) that is not supposed to be displayed suddenly may be displayed, and may be peeped.

Further, when the image displayed on the sub-display 16 is displayed on the main display 14 in a large size when the display mechanism is opened, the image becomes easy to see for the observer, and thus the risk of information leakage becomes high.

Therefore, in the present embodiment, when the display mechanism is changed from the closed state to the open state, the information processing device 10 executes a display process (hereinafter referred to as "a process of performing blocking") for reducing the visibility of the screen displayed in the display area of the main display 14.

As for the process of performing occlusion, for example, as shown in fig. 3, an occlusion image 30 is displayed in a superimposed manner (i.e., overlaid manner) on the screen 15 displayed in the display area of the main display 14. In this example, the mask image 30 is a translucent image covering the entire screen 15. The occlusion image 30 is an image in which the visibility of an image on which the occlusion image 30 is superimposed (i.e., an image of a layer located below the occlusion image 30) is reduced. The occlusion image 30 may be a single color uniform image or may include a pattern for increasing the difficulty of peeking by a viewer. The user can observe the screen 15 thereunder through the overlapped mask image 30. However, since the contrast of the display content of the screen 15 is reduced by being covered with the mask image 30, the display content becomes less visible to the observer than when the display content is not covered with the mask image 30 in the related art.

In this way, in the example of fig. 3, by displaying the mask image 30 in the display area of the main display 14, the risk of information leakage from the main display 14 when the display mechanism changes from the closed state to the open state is reduced. In this example, for example, it is possible to prevent an event (for example, the image 19 of a face photograph) that is not displayed on the screen 17 when the display means is in the closed state from being displayed accidentally (that is, without giving the user time to deal with it) on the screen 15 after the change to the open state.

Here, it is also possible to set a condition related to the display of the mask image 30 when the display means is changed from the closed state to the open state.

Here, the conditions related to display include, for example, a condition that defines whether or not the mask image 30 is displayed when the display means is changed from the closed state to the open state. The condition defines whether or not to display the mask image 30, based on, for example, one or more information of the position, time, application displayed on the screen in the closed state, the type of the communication means, the measurement result of the peripheral situation, and the like.

The position may be, for example, a place where the mask image 30 is displayed, a place where it is not displayed, or both of them may be set, as in the case of displaying the mask image outside the home. The "location" referred to herein is a location (i.e., a geographical position) where the information processing apparatus 10 is located. For example, a place where the mask image 30 is displayed is set (that is, the mask image 30 is displayed when the information processing device 10 is located at the place), and the mask image 30 may be set to be non-displayed at a place other than the set place. Conversely, a place where the mask image 30 is not displayed may be set, and the mask image 30 may be displayed in a place other than the set place.

In addition, the time of day may be, for example, a time zone in which the mask image 30 is displayed, a time zone in which the mask image is not displayed, or both of them may be set, such that the display is performed during the daytime (for example, during a period from 9 am to 5 pm), or the display is not performed during the nighttime, that is, during a time zone other than the daytime.

In addition, as for the application that displays the screen in the closed state, it is possible to set a condition for specifying the application that displays the mask image 30, a condition for specifying the application that does not display, or both of them. Here, for example, the condition for determining the application for displaying the occlusion image 30 may be a condition for determining each application for displaying the occlusion image 30. When the applications are classified, it is possible to set conditions for specifying the type of application for displaying the mask image 30. Consider, for example, the following settings: the mask image 30 is not displayed in the case of an application conforming to the type of game application, and is displayed in the case of an application for financial transactions.

Further, in the case of an application where personal information or confidential information may be displayed, it can be said that the necessity of displaying the mask image 30 is high. Therefore, the information processing apparatus 10 may determine whether or not personal information or confidential information is included in the display content of the screen generated by the application being executed by a predetermined determination program, and may display the mask image 30 when the on state is changed if it is determined that the personal information or confidential information is included. The display content to be determined may be the display content of the sub-display 16 in the closed state, the display content of the main display 4 in the open state, or both of them. For example, it may be determined whether or not one or more items displayed in the open state, but not displayed in the closed state, of the display content of the application include personal information or confidential information, and the mask image 30 may be displayed if the one or more items include personal information or confidential information, and the mask image 30 may not be displayed if the one or more items do not include personal information or confidential information. The determination program may be executed by the information processing apparatus 10 or may be executed by a server on a network. As such a determination program, various determination programs have been proposed in the past, for example, a method of determining whether or not a specific character string or specific attribute data is included in a screen displayed in a display area of the main display 4, and these existing determination methods can be used in the present embodiment. Further, the user may set personal information or confidential information to be searched for from the display content during the determination. For example, the personal information or the confidential information to be searched may be set in the form of a type of an item in the display content such as a name, an amount, and a face photograph image, or may be set in the form of a specific character string such as "confidential outside the company".

Further, among the display-related conditions, the condition items related to the types of communication means specify whether the mask image 30 is displayed or the mask image 30 is not displayed when the communication means used for the communication between the information processing apparatus 10 and the external apparatus is the communication means. For example, a white list, which is a list of networks that do not need to display the occlusion image 30, may be set. For example, if the network to which the information processing device 10 is currently connected is a white-listed network, the screen 15 is displayed on the main display 14 so that the mask image 30 is not displayed when the display mechanism is changed from the closed state to the open state. On the other hand, if the network in the current connection is not a network within the white list, the occlusion image 30 is displayed on the image of the screen 15 displayed on the main display 14. Instead of the white list, a black list (i.e., a list of networks on which the occlusion image 30 needs to be displayed) may be set. It is sufficient to determine which network the information processing apparatus 10 is currently connected to, for example, by identification information of a wireless access point to which the information processing apparatus 10 is connected.

Further, among the display-related conditions, the condition items related to the measurement result of the peripheral situation specify whether the occlusion image 30 is displayed or not displayed when the peripheral situation of the own apparatus detected by the information processing apparatus 10 is any situation. For example, when a third person (i.e., a person other than the user of the information processing apparatus 10) exists around the information processing apparatus 10, the mask image 30 may be displayed. Whether or not a third party is present in the vicinity of the information processing device 10 may be determined based on, for example, sound detected by a microphone incorporated in the information processing device 10, an image captured by an incorporated camera, information on whether or not a terminal is present in the vicinity of the information processing device 10 detected by proximity communication such as Bluetooth (registered trademark) or proximity communication such as NFC.

Whether or not to display the mask image 30 may be determined by combining the plurality of condition items regarding the position, time, application, and the like, which are exemplified above, individually or by a predetermined combination method. For example, the occlusion image 30 may be displayed when all items selected in advance in the position, time, application, AND the like satisfy the condition for displaying the occlusion image 30 (i.e., AND condition). OR, the occlusion image 30 may be displayed as long as at least 1 item of the pre-selected items satisfies a condition for displaying the occlusion image 30 (i.e., an OR condition). For example, the user may set how (for example, the above-described AND condition OR condition) to the information processing device 10 to obtain the final determination result of whether OR not to display the mask image 30 from the combination of the determination results of the respective condition items.

Further, the contents of the conditions relating to the position, the time, the communication means, and the like may be individually set for each application or each type of application.

The conditions for displaying the mask image 30 may include conditions for defining other aspects related to display, in addition to the conditions for defining whether or not display is necessary, which have been described above. For example, the conditions related to the display of the mask image 30 may include conditions that define the properties of the displayed mask image 30, such as transparency, density, color, and display duration. For example, the properties of the mask image 30 corresponding to the above-described items such as position, time, application, and the like, or a predetermined plurality of combinations of the above-described items may be set.

The function of controlling the display of the mask image 30 when the state is changed from the closed state to the open state may be provided to an OS (operating system) controlling the information processing apparatus 10, or a security application realizing such a function may be prepared.

The setting of the display-related condition is performed by opening a predetermined setting screen. Fig. 4 shows an example of such a setting screen 40. In this setting screen 40, the mask image 30 is referred to as "mask". The setting screen 40 includes: a basic setting column 42 for setting the validity (i.e., validation) and invalidity (i.e., invalidation) (in the figure, the valid flag is ON and the invalid flag is OFF) of the guard function itself; and a setting column 44 for setting the detailed conditions when the safeguard function is effective.

When the invalidation is selected in the basic setting field 42, the guard display is invalidated. That is, when the state is changed from the closed state to the open state, the mask image 30, which is the protection image, is not displayed.

When the basic setting field 42 is selected to be valid, whether or not to display a guard is determined in accordance with the setting contents of each condition item in the setting field 44 of the detailed condition. In the example of fig. 4, the setting field 44 includes a UI for accepting designation of an application to be displayed in the guard, a "time zone" in which the guard is displayed, a "place" in the geography of the information processing apparatus 10 in which the guard is displayed, and a display target of the guard. In the illustrated example, the guard is displayed when the current time is within a time period of 10 o 'clock to 17 o' clock, the information processing apparatus 10 is located outside the "own home" registered in advance, and the application being displayed in the sub-display 16 is "address book" or "mail".

Fig. 4 shows an example of the setting screen 40 displayed on the sub-display 16 when the display mechanism is in the closed state, but a similar setting screen may be displayed on the main display 14 when the display mechanism is in the open state to accept settings from the user. The setting screen 40 may be called up using a conventional UI technique, such as a slide gesture from an edge of the screen or a click of an icon for calling up the setting screen displayed on the screen.

Fig. 5 illustrates a processing procedure of the display control of the guard performed by the information processing apparatus 10 in accordance with the setting on the setting screen 40 of fig. 4. In this step, the information processing device 10 monitors the occurrence of an event in which the display mechanism changes from the closed state to the open state (S10). When such an event occurs, the information processing device 10 determines whether the setting of the basic setting field 42 is "valid" (S12). If the result of the determination is negative, the guard is not displayed, and the processing step is ended. If the result of the determination of S12 is yes, the information processing apparatus 10 determines whether the current time is within the set time period (S14), whether the current position of the information processing apparatus 10 satisfies the condition of the set position (place other than "own home" in the example of the drawing) (S16), and whether the application being displayed in the sub-display 16 conforms to the subject application (S18). If all of these determinations are yes, the guard is superimposed on the screen 15 displayed on the main display 14 (S20). If any of the determinations at S14, S16, and S18 is negative, S20 is skipped and the processing is ended.

In the step of fig. 5, when the display mechanism in the closed state is changed to the open state in the state in which the basic setting field 42 of the setting screen 40 of fig. 4 is selected to be invalid, the information processing apparatus 10 displays only the screen 15 of the application in the display area of the main display 14 regardless of whether or not the detailed conditions shown in the setting field 44 are satisfied. However, this is merely an example. As another example, in such a state, when the display means in the closed state is opened or when an opening operation is detected, the information processing apparatus 10 may check whether or not the detailed condition is satisfied, and if so, may perform warning processing. The warning processing may be, for example, output of a warning sound, processing for vibrating the information processing apparatus by a vibration mechanism, lighting or blinking of a warning lamp or the like provided in the information processing apparatus 10, warning display on the sub display 16 or the main display 14, or a combination thereof.

The UI for setting the display state of the mask image 30 as the protection, or the display state of the mask image 30 may be displayed in the mask image 30 or may be displayed together with the mask image 30. Fig. 6 shows an example of such a UI.

The "padlock" type icon 32 in the illustrated UI is used to receive an instruction to switch between effective and ineffective occlusion images 30. When the mask image 30 is active, i.e., being displayed, the icon 32 is in a specific form, for example, a "closed lock" form. When the user clicks the icon 32 in this form with a finger, the mask image 30 is in an invalid, i.e., non-displayed state (or transparency 100%), and the icon 32 is in another specific form, for example, the form of "open lock". When the user clicks the icon 32 in this state, the mask image 30 becomes effective.

The transparency adjustment bar 34 shown below the icon 32 is used to accept adjustment of the transparency of the mask image 30. In this example, the transparency can be adjusted in 4 stages, and displayed up to a value where the second segment from the top among the 4 segments represents the transparency. For example, the transparency is highest when all of the 4 segments are displayed, and the transparency is lowest when only 1 segment is displayed.

An icon 36 shown in the lower left corner of the occlusion image 30 is used to call up a setting screen for detailed setting for the occlusion image 30.

The icon 38 in the shape of a pin shown in the upper left corner of the occlusion image 30 is an icon for accepting a fixed instruction of the occlusion image 30. Although not shown, the icon 38 has two states of valid/invalid, and the valid and invalid are distinguished according to the display mode (e.g., display color) of the icon 38. The validity/invalidity of the icon 38 is switched by clicking on the icon 38. When the icon 38 is made active, the occlusion image 30 is fixed in the current state. That is, although the mask image 30 may be moved or the size of the mask image 30 may be changed by a touch operation on the main display 14, such an operation of moving or changing the size is not accepted when the icon 38 is in the active state. On the other hand, when the icon 38 is in the invalid state, the operation of moving or changing the size of the mask image 30 is accepted. When the user desires to change the size or position of the mask image 30 displayed in the display area of the main display 14 when the display mechanism is opened, the user sets the icon 38 to the inactive state as necessary, and then changes the size or position of the mask image 30 displayed in the display area by a gesture on the touch panel. When the user desires to fix the changed size and position, the user clicks the icon 38 to set the icon in an active state.

The mask image 30 may be fixed not to the main display 14 but to the display content displayed on the display 14 by making the icon 38 effective. When the display content displayed on the screen of the main display 14 is moved by the scroll operation, the mask image 30 moves similarly to the movement. For example, as a result of the user zooming in and out the mask image 30 on the screen in the state shown in fig. 6, the mask image 30 is in a state of masking only the image 19 of the face photograph on the screen as illustrated in fig. 7, and it is assumed that the mask image 30 is fixed by the icon 38 in this state. Thereafter, when the user scrolls the screen and moves the display content including the image 19, the mask image 30 similarly moves, and the state of overlaying the image 19 is maintained.

In addition, the fixation of the mask image 30 to the display content may be limited to a case where the mask image 30 covers a part of the screen on the main display 14. In this case, when the mask image 30 is fixed while maintaining a state of covering the entire area of the main display 14, even when the screen 15 of the application in the mask image 30 is scrolled, the mask image 30 maintains a state of continuously covering the entire screen area of the main display 14.

In fig. 6, the display state of the mask image 30 is set by masking the icons 32 to 38 displayed on the image 30, but instead of or in addition to this, touch gestures corresponding to the icons 32 to 38 may be defined. For example, a gesture of three quick consecutive clicks is defined as a gesture for instructing switching between fixing and release of fixing of the mask image 30, similar to pressing of the icon 38.

In the example of fig. 6, the mask image 30 simply covers the entire display area of the main display 14 uniformly, but this is merely an example. As another example, the mask image 30 may be controlled to be a mask image according to the display content of the screen 15 displayed in the display area of the main display 14.

For example, the information processing device 10 may recognize only a part having a meaning such as character information or a photograph image from the entire image displayed on the screen of the main display 14, and generate the mask image 30 that strongly masks the part having the meaning than other parts. In the example shown in fig. 8, from the screen of the application displayed on the main display 14, an area of the image 19 of the face photograph and 2 areas showing character information related to the contact address are extracted as parts having a meaning. Then, by covering these areas with the occlusion images 30A, 30B, 30C, the transparency of the occlusion images 30A, 30B, 30C is lower than the transparency of other areas on the screen (i.e., the visibility of the images thereunder is further reduced). In the illustrated example, the region other than the mask images 30A, 30B, and 30C in the screen is also covered with the mask image 30 having a higher transparency, but for example, such a mask image 30 may not be displayed.

In the example of fig. 8, the character information area and the photo image area are covered with the mask images 30A to 30B having the same transparency, but this is merely an example. For example, if the transparency of the mask image 30A of the photo image is lower than that of the mask images 30B and 30C of the character regions, the property (for example, transparency) of the mask image of each region may be set according to the type of the display content of each region such as the character information and the photo image.

Here, when dividing the entire area of the image displayed on the screen, a known area analysis process (also referred to as a drawing/character analysis) may be used, in which the feature of the image of the document is analyzed to determine an area such as a character, a photograph, or a table included in the image. Further, the type of each object such as a character string and an image included in the display content of the screen may be determined by analyzing the source code of each object, and the object may be divided into regions for each object.

In addition to or instead of the area analysis processing, it is also possible to determine whether or not the content displayed in each area in the screen 15 includes personal information or the like by a known technique, and to make the transparency of a mask image covering the area including the personal information or the like lower than the transparency of a mask image covering the other area.

The information processing device 10 receives a user input to the screen 15 of the application displayed in the display area of the main display 14 while displaying the mask image 30 superimposed on the screen 15.

For example, when a UI object for accepting an operation from a user is present in the display content of the screen 15, the information processing device 10 accepts the operation when the user operates the UI object viewed through the mask image 30 by a touch operation. Specifically, in the display state of the screen 15 of the address book application of the main display 14 illustrated in fig. 3, the UI icons 20 to 24 for calling up each application such as a telephone application in the screen 15 can be seen through the mask image 30. When the user clicks any of the icons 20 to 24 with respect to the main display 14 in this display state, the information processing apparatus 10 recognizes the click not as a click on the mask image 30 but as a click on the icon in the screen 15 therebelow. This starts the application corresponding to the icon.

Further, as in the example of fig. 6, there may be a case where UIs (for example, icons 32 to 38) for setting the display state of the mask image 30 are displayed in the mask image 30. In this case, if the location where the user touches on the main display 14 is the UI, the information processing apparatus 10 may recognize the touch as an operation for the UI. In this case, if there is no UI for setting the display state of the mask image 30 in the place touched by the user, the information processing apparatus 10 recognizes the operation of the user based on the touch as an operation on the screen 15 of the application located below the mask image 30.

As another example, the user may specify whether the user's touch operation on the main display 14 is an operation on the mask image 30 or an operation on the screen 15 of an application below the mask image 30 by a previous operation in the information processing apparatus 10. For example, a predetermined specific touch operation (an operation that is not easily used in a normal operation scene, such as a simultaneous click of a screen with 3 fingers) may be defined as an operation in advance that notifies that an operation is to be performed on the screen 15 of an application. When the user performs such a specific touch operation, the information processing apparatus 10 enters a mode for accepting an operation on the screen 15. While in this mode, the information processing device 10 recognizes the touch operation by the user as an operation on the screen 15 instead of the mask image 30. Likewise, a specific operation for releasing the mode may also be defined.

Note that the operation of switching the mode may be defined as an operation of a mode other than the touch operation. For example, an icon (not shown) for mode switching may be displayed in the mask image 30, and the user may click the icon to switch the mode in a toggle (toggle) manner. In one example, when the mask image 30 is displayed first, as illustrated in the state (a) of fig. 9, the icon 39 for receiving the mode switching instruction is displayed on the mask image 30, and the other icons 32 to 38 for setting the display of the mask image 30 are not displayed (see fig. 6). In this state, the information processing device 10 is in a mode of receiving an operation on the screen 15 below the mask image 30. In this mode, in the information processing apparatus 10, if the place touched by the user is a place other than the icon 39, the information processing apparatus 10 recognizes the operation based on the touch as the operation on the screen 15 of the application below the mask image 30. Further, when the user clicks the icon 39 in this state, the information processing apparatus 10 switches to a mode in which an operation from the user is recognized as an operation for the mask image 30. The display state of the screen in this mode is shown as state (b) of fig. 9. In the state (b), other icons 32-38 for setting the display of the mask image 30 are further displayed in the mask image 30. In this state, when the user touches the position of the icons 32 to 38 or performs a predetermined touch operation instructing movement or size change of the mask image 30, the information processing apparatus 10 recognizes the operation as an operation on the mask image 30. Further, when the user clicks the icon 39 in this state, the mode of the state (a) is returned.

The embodiments described above are merely exemplary embodiments, and it is considered that various changes and modifications can be made within the scope of the present disclosure.

For example, instead of the translucent mask image 30, an image superimposed on the screen 15 of the application displayed in the display area of the main display 14 when the display mechanism is changed from the closed state to the open state may be an opaque image. By being opaque, the risk of the screen 15 being peeped by a third person is eliminated. A UI (e.g., an icon) for receiving an instruction to erase or render the image may be displayed on the opaque image. When the user clicks the icon, the information processing apparatus 10 causes the opaque image to be erased or the transparency of the image to be increased, thereby enabling the user to see the contents of the screen 15.

Further, when the display mechanism is changed from the closed state to the open state, the information processing device 10 may display a predetermined image on the screen 15 of the application displayed in the display area of the main display 14, the predetermined image being displayed in a superimposed manner, the predetermined image being known to contain microsecond information such as personal information and confidential information in advance. Examples of such a predetermined image include a calendar screen generated by a calendar application, a clock screen generated by a clock application, a news screen generated by a news application, a screen of a specific website registered in advance by a user, and the like.

In addition, the following case is exemplified as above: when the display mechanism is changed from the closed state to the open state, the same application screen as that displayed on the sub-display 16 in the closed state is displayed on the main display 14. However, this is merely an example. By also displaying the occlusion images 30 in an overlapping manner, the risk of information leakage is reduced, in the following cases: when the display mechanism is changed from the closed state to the open state, instead of or in addition to the screen of the application displayed on the sub-display 16, the main display 14 displays a screen of one or more other applications registered in advance as an application associated with the application.

In the above example, the processing of blocking the screen 15 displayed in the display area of the main display 14 when the display mechanism is changed from the closed state to the open state is processing of covering the screen 15 with the blocking image 30, but this is merely an example. Instead, as the processing for performing the blocking, for example, processing for making the brightness, the display contrast, and the like of the main display 14 lower than the values set in the OS may be employed.

In the example shown above, more items are displayed on the screen 15 displayed on the main display 14 than on the screen 17 displayed on the sub-display 16. However, the control of the above embodiment is not limited to this case, and may be meaningful to some extent even when the display content of the screen 17 is merely displayed in an enlarged manner on the screen 15. For example, when a map screen generated by a map application is displayed, an image displayed on the display screen 17 is enlarged on the screen 15. In this case, since the content displayed is displayed in an enlarged manner, it is easier for the viewer to see the content displayed than the display on the screen 17, and therefore, it is considered useful to perform a process of blocking the content so that the content displayed is not easily seen.

In the above-described example, the information processing device 10 is a system in which the display mechanism is folded by providing the main display 14 on the inner side. The information processing apparatus 10 of the fold-in type has a sub-display 16 that displays in the closed state, and is a display physically different from the main display 14 that displays in the open state. However, the method of the above embodiment can also be applied to a folding-type information processing apparatus in which the display mechanism is folded by providing the main display 14 on the outside. In the case of the fold-out type, the main display 14 is roughly divided into two parts, i.e., a front display region and a rear display region of the closed display mechanism in the closed state. The information processing apparatus uses, as a display region to be viewed by the user, a display region located on the upper side in the gravity direction, for example, of the front and rear 2 display regions, and displays a screen using a portion of the main display 14 corresponding to the upper display region. The portion displayed at this time corresponds to the 1 st display area in which the 1 st screen is displayed in the closed state. When the state is changed from the closed state to the open state, the entire main display 14 displays the image, but the portion to be displayed at this time, that is, the entire area of the main display 14 corresponds to the 2 nd display area in which the 2 nd screen is displayed. The "processing for performing occlusion" may be performed to display the occlusion image 30 or the like when the 2 nd screen is displayed in the 2 nd display region in association with the deformation from the closed state to the open state.

The method of the above embodiment can also be applied to an information processing apparatus having a structure in which a large area is reduced by a method other than folding the large-area main display 14 corresponding to the 2 nd display area to be displayed in an open state, for example, a method of winding up a reel. In the case of a device having a structure in which the main display 14 is wound like a reel, the state in which the main display 14 is wound corresponds to the closed state, and conversely, the state in which the entire wound main display 14 is pulled out to be substantially flat corresponds to the open state. In the closed state, a part of the main display 14 that is wound up and visible from the outside or a small display that is provided separately from the main display 14 in the apparatus displays the image. The portion or small display to be displayed at this time corresponds to the 1 st display area in which the 1 st screen is displayed in the closed state. When the state is changed from the closed state to the open state, the screen is displayed on the entire main display 14, but in this case, the entire main display 14 corresponds to the 2 nd display area in which the 2 nd screen is displayed. When the 2 nd screen is displayed in the 2 nd display region in association with the deformation from the closed state to the open state, "processing for performing occlusion" may be performed to display the occlusion image 30 or the like.