JP2015108875A - Information processor, information processing method, and information processing program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide information at an appropriate timing without causing a user to be aware of it.SOLUTION: The information processor includes: a storage part for storing predetermined information; a detection part for detecting the switching operation of a browsing object from an operation input; and a determination part for determining the output of predetermined information on the basis of relevancy between browsing objects switched by a switching operation. The information processor further includes: a display processing part for allowing a display device to display predetermined information; and an extraction part for extracting the format of a display screen image displayed by the display device. The display processing part arranges information on the predetermined information stored by the storage part at the predetermined position of the display screen image in accordance with the format of the display screen image to allow the display device to display the information on the predetermined information.

Description

  The present invention relates to an information processing apparatus, an information processing method, and an information processing program.

  Some applications for smartphones, tablet terminals, etc. store collected information for later viewing. Further, there is an application that adjusts the timing according to the user's behavior and presents the stored information to the user at the adjusted timing (for example, Patent Document 1).

JP 2000-99441 A JP 2010-39805 A JP-A-6-325029 JP 2006-2111435 A JP 2008-67120 A

  However, information stored for later viewing may be left unviewed. In addition, in an application that presents information stored for later viewing to the user, the setting of the presentation timing has been performed by the user in advance. For this reason, there is a case where the actual user's state is not sufficiently considered and information is not presented at a timing desirable for the user.

  An object of one embodiment of the present invention is to provide an information processing apparatus, an information processing method, and an information processing program that can provide information at an appropriate timing without being conscious of a user.

One aspect of the present invention is:
A storage unit for holding predetermined information;
A detection unit for detecting a switching operation of a browsing target from an operation input;
A determination unit that determines the output of the predetermined information based on the relationship between the browsing objects switched by the switching operation;
Is an information processing apparatus.

  Another aspect of the present invention is an information processing method in which an information processing apparatus performs the above processing. Another aspect of the present invention can include an information processing program that causes a computer to function as the above-described information processing apparatus, and a computer-readable recording medium that records the program. A recording medium that can be read by a computer or the like, in which information such as data or a program is stored non-temporarily by electrical, magnetic, optical, mechanical, or chemical action on a computer-readable recording medium Say medium.

  According to the disclosed information processing apparatus, information processing method, and information processing program, information can be provided at an appropriate timing without the user being aware of it.

It is a figure which shows an example of the detection process of the zapping which concerns on 1st Embodiment. It is a figure which shows an example of the hardware constitutions of a portable terminal. It is a figure which shows an example of a function structure of the portable terminal which concerns on 1st Embodiment. It is an example of the flowchart of a process of a browsing possible state determination. It is an example of the flowchart of a browsing time measurement process. It is an example of the flowchart of the determination process of estimated browsing time. It is an example of the flowchart of the determination process of a display timing. It is an example of the flowchart of the determination process of the browsing pending | holding information of a display object. It is a figure which shows an example of the presentation method of the browsing suspension information in a modification. It is a figure which shows an example of a function structure of the portable terminal which concerns on the display process of a modification. It is a figure which shows the function structural example of a screen reconstruction part. It is a figure which shows an example of a design extraction process. It is a figure which shows an example of a screen reconstruction process. It is a figure which shows an example of the information which a screen reconstruction part handles in a modification. It is an example of the flowchart of a process of a notification display determination part. It is an example of the flowchart of a process of a screen structure extraction part. It is an example of the flowchart of the process of a design extraction part. It is an example of the flowchart of a process of the notification content preparation part. It is an example of the flowchart of a process of a screen adjustment part. It is an example of the flowchart of a process of a user operation determination part.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The configuration of the following embodiment is an exemplification, and the present invention is not limited to the configuration of the embodiment.

<First Embodiment>
The information processing apparatus according to the first embodiment is an apparatus that outputs the stored information when, for example, it is detected that the user can browse the information stored for later browsing. . In the first embodiment, the information processing apparatus detects that the user can browse the stored information by detecting the state where zapping is performed. The information stored for later browsing is hereinafter referred to as browsing hold information.

  FIG. 1 is a diagram illustrating an example of zapping detection processing according to the first embodiment. Zapping is essentially an act of viewing a television while frequently switching channels. In the first embodiment, in browsing information using the information processing apparatus, an action in which a user browses miscellaneous information while switching a browsing target without a predetermined purpose is defined as zapping. Therefore, in the first embodiment, the state in which zapping is performed is detected as a state in which the user can browse the browsing suspension information. Hereinafter, the state in which the user can browse the browsing suspension information is simply referred to as “viewable state”.

In the first embodiment, the information processing apparatus detects that zapping is performed when the following conditions are satisfied.
(Condition 1) Relevance between browsing objects displayed on the information processing apparatus is low.
(Condition 2) The browsing time of each browsing target is within a predetermined time range corresponding to the amount of information.
(Condition 3) An input operation indicating the user's positive intention is not performed for a predetermined time.

Regarding condition 2, in zapping, since the user browses information without having a predetermined purpose, an operation is often performed in which the user moves to the next display content by looking through the display content. Therefore, in the first embodiment, during zapping, it is assumed that the browsing time of each browsing target is within a predetermined time range with respect to the information amount. On the other hand, in the first embodiment, the state in which the browsing time with respect to the amount of information to be browsed is too short or too long is a state in which the user is performing an operation with a positive intention or a predetermined purpose, that is, Browsing pending information is considered to be inaccessible.

  As for condition 3, in zapping, the user browses information without having a predetermined purpose. Therefore, in the first embodiment, when there is an input operation indicating the user's positive intention, zapping is not performed. Is determined. The input operation indicating the user's positive intention includes, for example, character input, pressing input of an operation button such as a selection button, and the like.

  Hereinafter, the first embodiment will be described assuming that the information processing apparatus is a mobile terminal. In addition, for information browsing, it is assumed that, for example, an application that converts a file described in a markup language such as HTML (HyperText Markup Language) into a display form and displays the file is used. The contents of one file described in the markup language are referred to as “pages”. A part or all of the file (page) displayed on the display screen is referred to as a “screen”. The page is an example of “browsing target” in the aspect. The screen is an example of a “display screen image”. In addition, the premise of 1st Embodiment is not restricted to these.

<Configuration of mobile terminal>
FIG. 2 is a diagram illustrating an example of a hardware configuration of the mobile terminal 1. The mobile terminal 1 is, for example, a smartphone, a tablet terminal, a mobile phone terminal equipped with a touch panel, a notebook computer, or the like. The mobile terminal 1 includes a CPU (Central Processing Unit) 11, a storage unit 12, a touch panel 13, a display 14, a wireless unit 15, an audio input / output unit 16, a speaker 17, a microphone 18, and an antenna 19.

  The storage unit 12 includes a ROM (Read Only Memory) 12A and a RAM (Random Access Memory) 12B. The RAM 12B includes both volatile and nonvolatile ones. The ROM 12A stores a browsing hold information display program. The browsing hold information display program is a program for displaying the browsing hold information at a timing at which the user can browse. The browsing suspension information display program may be stored in the nonvolatile RAM 12B. In addition, a program such as an OS (Operating System) is also stored in the ROM 12B or the nonvolatile RAM 12A. The browsing hold information display program is an example of an “information processing program”.

  The touch panel 13 is one of position input devices, and is disposed on the surface of the display 14. The touch panel 13 inputs the coordinates of the finger touch position corresponding to the screen of the display 14. The touch panel 13 is a capacitive type in the first embodiment. However, it is not limited to this. For example, the touch panel 13 may be a resistance film method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, or the like.

  The display 14 is, for example, a liquid crystal display (LCD). The display 14 displays screen data according to a signal output from the CPU 11.

  The wireless unit 15 is connected to the antenna 19, converts a wireless signal received through the antenna 19 into an electrical signal and outputs the electrical signal to the CPU 11, or converts an electrical signal input from the CPU 11 into a wireless signal and transmits the antenna. 19 to transmit. The wireless unit 15 is, for example, one or more electronic circuits of a third generation mobile communication system, a second generation mobile communication system, LTE (Long Term Evolution), Wireless LAN, WiMAX, and the like.

  The audio input / output unit 16 is connected to a speaker 17 as an audio output device and a microphone 18 as an audio input device. The audio input / output unit 16 converts an audio signal input from the microphone 18 into an electric signal and outputs the electric signal to the CPU 11, or converts an electric signal input from the CPU 11 into an audio signal and outputs the audio signal to the speaker 17. To do.

  Note that the hardware configuration of the mobile terminal 1 is not limited to that shown in FIG. 2, and can be appropriately changed such as addition, replacement, and deletion. For example, the mobile terminal 1 may include an image processing circuit specialized for image processing in addition to the configuration shown in FIG. For example, in the configuration shown in FIG. 2, the mobile terminal 1 may include an input device such as a pointing device such as a keyboard and a mouse instead of the touch panel 13. The mobile terminal 1 is an example of an “information processing apparatus” in the aspect. The “information processing apparatus” may be a stationary type other than the portable terminal. An example of a stationary “information processing apparatus” is a PC (personal computer).

  FIG. 3 is a diagram illustrating an example of a functional configuration of the mobile terminal 1 according to the first embodiment. The mobile terminal 1 includes, as functional blocks, a user operation detection unit 101, an information access monitoring unit 102, an information extraction unit 103, an information amount determination unit 104, a browsing time measurement unit 105, a browsing time estimation unit 107, a relevance determination unit 109, A browseable state determination unit 110, an operation application detection unit 111, a display timing determination unit 113, a display information determination unit 114, a display result selection reflection unit 116, and a display unit 117 are included.

  User operation detection unit 101, information access monitoring unit 102, information extraction unit 103, information amount determination unit 104, browsing time measurement unit 105, browsing time estimation unit 107, relevance determination unit 109, browsing enabled state determination unit 110, operation application The detection unit 111, the display timing determination unit 113, the display information determination unit 114, the display result selection reflection unit 116, and the display unit 117 are functions realized, for example, by the CPU 11 executing a viewing suspension information display program.

  The browsing time information database (DB) 106, the predicted browsing time information DB 108, the timing learning information DB 112, and the browsing suspension information DB 115 are stored in the storage unit 12 in advance or through execution of a browsing suspension information display program by the CPU 11, for example. In the storage area of the RAM 12B.

  The user operation detection unit 101 acquires the operation content from the coordinates of the touch position input from the touch panel 13 and generates operation information. The operation information includes the operation content input through the touch panel 13. The operation content includes, for example, a click on a link and a page scroll. Note that in the case of operation contents that involve page switching, such as a click on a link, the operation information includes identification information of an access destination page. The identification information of the access destination page is, for example, the URL (Uniform Resource Locator) of the corresponding page or the address of the storage location of the corresponding file. The user operation detection unit 101 outputs the operation information to the information access monitoring unit 102, the browseable state determination unit 110, and the display result selection reflection unit 116. An operation involving page switching such as a click on a link is an example of a “browsing target switching operation”. Hereinafter, page switching is also referred to as page movement.

The information access monitoring unit 102 accesses, from the operation information input from the user operation detection unit 101, access to a predetermined web page to the network, which is an operation accompanied by page switching, or access to previously downloaded information. To detect. This detection is determined, for example, when the operation information is an operation (page movement operation) that causes movement of the browse page such as a click on a link or a press of a return button. The information access monitoring unit 102 generates information acquisition start information including the start of acquisition of the access destination page included in the operation information, and outputs the information acquisition start information to the information extraction unit 103. Further, the information access monitoring unit 102 generates display switching information including the start of display switching to the access destination page, and outputs the display switching information to the browsing time measuring unit 105 and the browsing enabled state determining unit 110. The information acquisition start information and the display switching information include, for example, identification information of the access destination page. The information access monitoring unit 102 is an example of a “detection unit”.

  The information extraction unit 103 acquires an access destination page when the information acquisition start information is input from the information access monitoring unit 102, and extracts a main part of the page. For example, when the acquired page is a page of a news article browsing application, the information extraction unit 103 extracts an article title, a body text, and the like as a main part of the page. For example, menu bars, advertisements, etc. included in the page are excluded from the main part of the page. For example, when the page is described in a markup language such as HTML, the extraction of the main part of the information is performed by extracting data sandwiched between tags indicating the main part to be extracted. Is called. Tags to be extracted are registered in advance (not shown). The information extraction unit 103 generates display information including the main part extracted from the access destination page, and outputs the display information to the information amount determination unit 104 and the relevance determination unit 109.

  When the display information including the main part of the page is input from the information extraction unit 103, the information amount determination unit 104 determines the amount of information included in the main part. When the main part includes characters, the information amount determination unit 104 determines the number of characters as the information amount. When a moving image is included in the main part, the information amount determination unit 104 determines the time length of the moving image as the information amount. When characters and moving images are mixed in the main part, the information amount determination unit 104 determines the number of characters and the time length of the moving image as the information amount. The information amount determination unit 104 generates information amount information including the determined information amount of the page, and outputs the information amount information to the browsing time measurement unit 105. The information amount information includes identification information of the corresponding access destination page. Further, the information amount determination unit 104 outputs the information amount information and display information of the corresponding page to the browsing time estimation unit 107.

  The browsing time measuring unit 105 starts measuring the browsing time of the page indicated by the display switching information, triggered by the input of the display switching information from the information access monitoring unit 102. The measurement of the browsing time ends when display switching information including information on different pages is input from the information access monitoring unit 102, and at the same time, the measurement of the browsing time of the page indicated by the newly input display switching information. Is started. The browsing time measurement unit 105 is an example of a “measurement unit”.

  Upon completion of the measurement of the browsing time of one page, the browsing time measuring unit 105 displays the information amount and the browsing time of the corresponding page based on the information amount information of the corresponding page input from the information amount determining unit 104. Store in the information DB 106. The browsing time information DB 106 stores a history of information amount of each page and browsing time. However, the browsing time when moved to another page in the middle of the page, that is, when the page has not been browsed to the end of the page, is not stored in the browsing time information DB 106. Whether the page has been browsed to the end can be determined by, for example, the position of the scroll bar when the browsing time measurement unit 105 receives the display switching information.

  The browsing time measurement unit 105 generates browsing time information including the measured browsing time and outputs the browsing time information to the browsing time estimation unit 107. The browsing time information includes, for example, page identification information, page information amount, and measured browsing time.

The browsing time estimation unit 107 stores the browsing time information input from the browsing time measurement unit 105 in the expected browsing time information DB 108. The expected browsing time information DB 108 stores, for example, the amount of page information and browsing time. In the expected browsing time information DB 108, for example, the information amount and the browsing time may be held for each identification information of the page, or the information amount is grouped by the number of characters of 30 to 100 characters, and the browsing time of each group. May be held. When the browsing time is held for the information amount group, the browsing time estimation unit 107 may update the browsing time of each group with the latest one, or average the browsing time history of each group. It may be updated. Further, in the estimated browsing time information DB 108, the browsing time range of each group may be held by holding the shortest browsing time and the longest browsing time of each group. The expected browsing time information DB 108 is an example of a “second storage unit”.

  The browsing time estimation unit 107 estimates the expected browsing time of the page indicated by the information amount information when the information amount information is input from the information amount determination unit 104. In the first embodiment, the browsing time estimation unit 107 obtains the browsing time with the closest information amount stored in the predicted browsing time information DB 108 as the predicted browsing time of the page indicated by the information amount information. The browsing time estimation unit 107 generates predicted browsing time information including the predicted browsing time, and outputs it to the browsing enabled state determination unit 110. The expected browsing time information includes identification information of the corresponding page. In addition, the browsing time estimation unit 107 outputs the display information, information amount information, and expected browsing time information of the corresponding page to the display information determination unit 114.

  When the display information is input from the information extraction unit 103, for example, the relevance determination unit 109 determines the relevance between the page indicated by the display information and the page indicated by the display information input immediately before. Calculate the numerical value shown. In the first embodiment, the relationship between pages is determined by obtaining the degree of matching between two pages using the method for calculating the degree of matching described in the international application PCT / JP / 2012/076094. . This method of calculating the fitness is a method of extracting feature words from the main part of the page included in the display information and calculating the fitness using the extracted feature words. However, the method for determining the relationship between pages is not limited to this, and any of methods for obtaining an existing relationship may be used. The relevance determination unit 109 generates fitness level information including the determined fitness level and outputs the fitness level information to the viewable state determination unit 110. The fitness information includes the identification information of two pages that are the targets of the fitness calculation, and the fitness between the two pages. The relevancy determination unit 109 is an example of a “calculation unit”. The degree of fitness is an example of “a numerical value indicating the relationship between browsing objects”.

  The operation application detection unit 111 detects a window or screen application displayed on the forefront of the display 14. The operation application detection unit 111 detects, for example, the window or screen application displayed in the foreground when the foreground window or screen changes to another window or screen. Further, the operation application detection unit 111 may detect the frontmost window or screen application in response to a request from another processing unit. Application detection is performed, for example, by inquiring the OS. The motion application detection unit 111 generates application information including the identification information of the window or screen application displayed on the foreground, and outputs the application information to the viewable state determination unit 110.

The browsing possible state determination unit 110 detects zapping when all of the following conditions A to E are satisfied, and determines that the user is in a state where browsing pending information can be browsed.
(Condition A) The application on the frontmost window or screen of the display 14 is a target application for the browseable state determination process.
(Condition B) The browsing time of the page is within the range of the expected browsing time ± acceptable range α corresponding to the amount of information.
(Condition C) Relevance to pages before and after movement is low.
(Condition D) A predetermined input operation is not performed.
(Condition E) The page movement satisfying the conditions A to D is continuously performed a predetermined number of times.

Regarding the condition A, the browseable state determination unit 110 determines based on the application information input from the operation application detection unit 111. For example, the target application for the browseable state determination process is registered in advance in a predetermined storage area of the RAM 12B. Examples of the target application for the browseable state determination process include information browsing applications such as a web browser, a news browsing application, and a blog browsing application.

  For the condition B, the browseable state determination unit 110 measures the browsing time of the corresponding page using the display switching information input from the information access monitoring unit 102 in the same manner as the browsing time measurement unit 105. The browsing enabled state determination unit 110 performs determination using the measured browsing time and the expected browsing time input from the browsing time estimation unit 107. For example, the allowable range α of the expected browsing time may change according to the information amount of the corresponding page.

  Regarding the condition C, the viewable state determination unit 110 performs the determination using the two pieces of fitness information including the identification information of the corresponding page input from the relevance judgment unit 109 and a preset fitness level threshold. Do. One of the two pieces of fitness information including the identification information of the corresponding page is the fitness information between the corresponding page and the page immediately before the corresponding page. The other fitness level information is the fitness level information of the corresponding page and the next page. Note that the browseable state determination unit 110 holds the fitness level information by buffering a predetermined number of times for a predetermined time.

  Regarding the condition D, the viewable state determination unit 110 performs determination based on operation information input from the user operation detection unit 101. A predetermined input operation satisfying the condition D is set in advance, and the setting is stored in, for example, the RAM 12B. The predetermined input operation is an operation performed with a positive will by the user and includes, for example, character input, button selection, and the like.

  The number of page movements in which the conditions A to D of the condition E are continuously satisfied is, for example, about 3 to 5 times. However, the predetermined number of times satisfying the condition E may be set arbitrarily and is not limited to a specific number.

  When the above conditions A to E are satisfied, the browseable state determination unit 110 determines a browseable state. When the browsable state determination unit 110 determines the browsable state, the browsable state determination unit 110 generates display permission information including display permission of the browsing hold information and outputs the display permission information to the display timing determination unit 113. The browseable state determination unit 110 is an example of a “determination unit”.

  When the display permission information is input from the browsing enabled state determination unit 110, the display timing determination unit 113 determines the timing for displaying the browsing suspension information. When the display timing of the browsing hold information is determined, the display timing determination unit 113 generates display timing information including an instruction to display the browsing hold information and outputs the display timing information to the display information determination unit 114.

  When the display permission information is input from the viewable state determination unit 110, the display timing selection information has been received for the initial state and all display timing information that has been output. It is determined at the timing when the display permission information is input. The display result selection information is a response to the display timing information, and is information indicating that predetermined browsing suspension information is displayed and browsed according to the output of the display timing information.

  On the other hand, when the display permission information is input from the viewable state determination unit 110, if there is output display timing information that has not been received, the display timing determination unit 113 displays the display timing information. The re-notification information is added and output to the display information determination unit 114. The re-notification information is information that instructs the display information determination unit 114 to select the same viewing suspension information as the previous display timing information. The re-notification information is also added to the display timing information even when the display result selection information is not received even after a predetermined time has elapsed since the generation of the display timing information.

  The display timing determination unit 113 records the number of notifications of display timing information in the timing learning information DB 112. The notification count of the display timing information is reset when the display result selection information is received or when the notification count exceeds a predetermined count. The display timing determination unit 113 determines whether to add re-notification information to the display timing information based on the presence / absence of the display timing information notification count in the timing learning information DB 112. When the notification count of the display timing information is not recorded in the timing learning information DB 112, the re-notification information is not added to the display timing information. When the notification count of the display timing information is recorded in the timing learning information DB 112, the re-notification information is added to the display timing information.

  The display information determination unit 114 determines the display hold information to be displayed when the display timing information is input from the display timing determination unit 113. The viewing suspension information to be displayed is selected from the viewing suspension information DB 115 when the re-notification information is not added to the display timing information. The browsing suspension information DB 115 stores browsing suspension information saved by the user. The browsing suspension information DB 115 is an example of a “storage unit”. The selection of the viewing hold information to be displayed may be selected randomly, for example, may be selected from the oldest in the storage order of the viewing hold information DB 115, or may be selected in order from the smallest information amount. Also good. Alternatively, the display information determination unit 114 uses the display information, the information amount information, the expected browsing time information, and the like input from the browsing time estimation unit 107 to display the browsing pending information whose information amount is similar to the access destination page. You may select as an object.

  When the re-notification information is added to the display timing information, the display information determination unit 114 selects the same viewing suspension information as the display target when the previous display timing information is input. The display information determination unit 14 outputs the display target information including the browse hold information of the selected display target to the display unit 117. The display target information includes, for example, browsing hold information selected as a display target, information on a link to the browsing hold information, and a request to display the browsing hold information.

  If the viewing suspension information displayed on the display 14 remains unviewed, the count of the number of times of the recorded display timing information increases, and the number of times of the notification is reset when it continues for a predetermined time. As a result, the display timing determination unit 113 outputs display timing information to which the re-notification information is not given to the display information determination unit 114. The display information determination unit 114 to which the display timing information to which the re-notification information is not given is input determines another browsing suspension information as a display target. The display information determination unit 114 is an example of a “determination unit”.

  The display unit 117 receives input of display target information from the display information determination unit 114 and causes the display 14 to display the browsing pending information to be displayed or a link to the browsing pending information. The display method may be any method such as pop-up and screen transition, and is not limited to a predetermined method.

The display unit 117 determines whether or not the displayed viewing suspension information is browsed based on an input of a user operation for displaying the viewing suspension information. For example, when the link of the browsing pending information to be displayed is displayed in a pop-up or the like, the display unit 117 determines browsing of the browsing pending information when the link is clicked. For example, when the viewing suspension information is provided by the screen transitioning to the viewing suspension information to be displayed, the display unit 117 displays the viewing suspension information depending on the position of the scroll bar on the display screen of the viewing suspension information. Judgment of browsing. When it is determined that the displayed browsing hold information is browsed, the display unit 117 generates display result selection information indicating that browsing of the browsing hold information is completed, and outputs the display result selection information to the display result selection reflection unit 116. The display result selection information includes identification information of the browsing suspension information displayed on the display 14. The display unit 117 is an example of a “display processing unit”.

The display result selection reflection unit 116 receives the input of the display result selection information from the display unit 117, outputs the display result selection information to the display timing determination unit 113, and also displays the reading suspension information DB.
The already-read information indicating that the user has been browsed is recorded in the browse hold information displayed in 115. The display result selection reflection unit 116 is an example of a “reflection unit”.

  The timing learning information DB 112 stores the number of display timing information notifications recorded by the display timing determination unit 113 and the time from the display timing information notification to the acquisition of the corresponding display result selection information.

<Process flow>
FIG. 4 is an example of a flowchart of a process for determining a browseable state. The flowchart shown in FIG. 4 is started when the portable terminal 1 is activated, and is repeatedly executed while the portable terminal 1 is activated. Further, the flowchart shown in FIG. 4 is a process corresponding to the browseable state determination unit 110.

  In OP <b> 1, the browsable state determination unit 110 detects the frontmost application based on the application information input from the operation application detection unit 111. In OP2, the browsable state determination unit 110 determines whether or not the detected application is a target application for the browsable state determination. The processing of OP1 and OP2 is processing for determining the condition A (the application on the frontmost window or screen of the display 14 is the target application for the browseable state determination processing).

  If the detected application is the target application for the browseable state determination (OP2: YES), the process proceeds to OP3. If the detected application is not the target application for the browseable state determination (OP2: NO), the process returns to OP1.

  In OP3, the browseable state determination unit 110 detects a page movement operation based on operation information input from the user operation detection unit 101. Next, the process proceeds to OP4.

  In OP4, the browseable state determination unit 110 determines whether or not the browsing time of the target page is within the range of the expected browsing time ± α included in the expected browsing time information input from the browsing time estimation unit 107. To do. The target page in OP4 is the page before the page movement that is displayed when the page movement operation is input. If the browse time of the target page is within the expected browse time ± α (OP4: YES), the process proceeds to OP5. If the browse time of the target page is not within the expected browse time ± α (OP4: NO), the process proceeds to OP8. OP4 is a process for determining the condition B (the browsing time of the page is within the range of the predicted browsing time ± allowable range α corresponding to the amount of information).

  In OP5, the browsable state determination unit 110 determines whether or not the suitability between the target page and each page before moving to the target page and after moving from the target page is equal to or less than the suitability threshold. Determine whether. In the first embodiment, when the relevance level calculated by the relevance determination unit 109 is lower than the relevance level threshold, it is determined that the relevance between the two pages that are the calculation targets of the relevance level is low. The degree of matching between the target page and the page before moving to the target page and after moving from each page of the target is acquired from the degree of matching information input from the relevance determining unit 109. OP5 is a process for determining the condition C (relevance to the pages before and after the movement).

If the matching level between the target page and each page before moving to the target page and after moving from the target page is less than or equal to the matching level threshold (OP5: YES), the process proceeds to OP6. . When the matching level between the target page and each page before moving to the target page and after moving from the target page is larger than the matching level threshold (OP5: NO), the process proceeds to OP8.

  In OP6, the browseable state determination unit 110 determines whether or not a predetermined input operation has been performed based on the operation information input from the user operation detection unit 101. The predetermined input operation is an operation performed according to the positive will of the user, and specifically includes character input, selection of a selection button, and the like. An operation to be a target of a predetermined input operation is set in advance. OP6 is a process for determining the condition D (a predetermined input operation is not performed). If a predetermined input operation is detected (OP6: YES), the process proceeds to OP8. If the predetermined input operation is not detected (OP6: NO), the process proceeds to OP7.

  In OP7, the browseable state determination unit 110 adds 1 to the number of page movements. The number of page movements indicates the number of times that the conditions A to D are continuously satisfied. The initial value of the number of page movements is zero. OP7 is a process for determining the condition E (page movement that satisfies the conditions A to D is continuously performed a predetermined number of times). Next, the process proceeds to OP9.

  In OP9, the browseable state determination unit 110 determines whether the number of page movements is greater than N times. N is an integer of 1 or more. If the number of page movements is N or less (OP9: NO), the process returns to OP3. If the number of page movements is greater than N (OP9: YES), the process proceeds to OP10. In OP10, the browseable state determination unit 110 detects a browseable state. The browsable state determination unit 110 generates display permission information and outputs it to the display timing determination unit 113. Thereafter, the processing shown in FIG. 4 ends and is executed again from OP1.

  In OP8, since the conditions A to D are not satisfied, the viewable state determination unit 110 resets the number of page movements. Thereafter, the process returns to OP3. OP7 to OP9 are processes for determining the condition E (page movement that satisfies the conditions A to D is continuously performed a predetermined number of times).

  The flowchart of the browseable state determination process shown in FIG. 4 is an example, and the order of the processes is not limited to the flowchart shown in FIG. For example, the condition determination process of OP4 to OP6 may be executed from any process.

  FIG. 5 is an example of a flowchart of browsing time measurement processing. The flowchart shown in FIG. 5 is started when, for example, a page moving operation by the user is detected. In the flowchart shown in FIG. 5, processes related to the browsing time measurement process are extracted and shown, and processes related to other processes are omitted. The page movement operation is detected by the information access monitoring unit 102. The information access monitoring unit 102 generates display switching information and information acquisition start information by detecting a page moving operation by the user. The display switching information is output to the browsing time measuring unit 105. The information acquisition start information is output to the information extraction unit 103.

  In OP11, the browsing time measuring unit 105 receives the input of the display switching information from the information access monitoring unit 102, and starts measuring the browsing time of the access destination page included in the display switching information. Next, the process proceeds to OP12.

  In OP12, the information extraction unit 103 receives input of information acquisition start information from the information access monitoring unit 102, and detects the display start of the access destination page. Next, the process proceeds to OP13.

In OP13, the information extraction unit 103 acquires a page from the access destination included in the information acquisition start information, and extracts the main part of the page. The information extraction unit 103 generates display information including the main part of the page and outputs it to the information amount determination unit 104. Next, the process proceeds to OP14.

  In OP14, the information amount determination unit 104 receives input of display information from the information extraction unit 103, and determines the information amount of the main part of the page included in the display information. The information amount determination unit 104 generates information amount information including the information amount of the main part of the page and outputs the information amount information to the browsing time measurement unit 105. At this time, the information amount determination unit 104 also outputs the information amount information to the browsing time estimation unit 107, and the browsing time estimation unit 107 determines the expected browsing time based on the information amount information (a flowchart described later). ). Next, the process proceeds to OP15.

  In OP15, the information access monitoring unit 102 newly detects a page moving operation by the user. The information access monitoring unit 102 generates display switching information and outputs it to the browsing time measuring unit 105. Note that the flow chart of FIG. 5 for measuring the browsing time of the new page is started in a separate process upon detection of a new page movement operation in OP15. Next, the process proceeds to OP16.

  In OP16, the browsing time measuring unit 105 receives the input of the display switching information from the information access monitoring unit 102, and ends the page browsing time measurement. Next, the process proceeds to OP17.

  In OP17, the browsing time measuring unit 105 determines whether page movement has occurred before all pages are displayed. If page movement has occurred since all pages have been displayed (OP17: NO), the process proceeds to OP18. If page movement occurs before all the pages are displayed (OP17: YES), the browsing time of the page is discarded without being recorded, and the processing shown in FIG. 5 ends.

  In OP18, the browsing time measuring unit 105 records the measured browsing time and the information amount of the corresponding page in the browsing time information DB 106. The browsing time measurement unit 105 generates browsing time information including the measured browsing time and the information amount of the corresponding page, and outputs the browsing time information to the browsing time estimation unit 107. Next, the process proceeds to OP19.

  In OP19, the browsing time estimation unit 107 updates the expected browsing time information DB 108 with the browsing time information input from the browsing time measurement unit 105. Thereafter, the process shown in FIG. 5 ends.

  The browsing time history information is collected by the process shown in FIG. 5. For example, the browsing time history information is used as the expected browsing time in the browsing enabled state determination process shown in FIG. 4. Further, by excluding the browsing time when the page movement occurs while all the pages are not displayed from the storage of the browsing time information DB 106, the variation in the browsing time used for determining the expected browsing time is suppressed. Can do.

  FIG. 6 is an example of a flowchart of the expected browsing time determination process. The flowchart shown in FIG. 6 is started, for example, when a page moving operation by the user is detected. In the flowchart shown in FIG. 6, the process related to the process for determining the expected browsing time is extracted and shown, and the processes related to other processes are omitted. The page movement operation is detected by the information access monitoring unit 102. The information access monitoring unit 102 generates display switching information and information acquisition start information by detecting a page moving operation by the user. The display switching information is output to the browsing time measuring unit 105. The information acquisition start information is output to the information extraction unit 103.

In OP21, the information extraction unit 103 receives input of information acquisition start information from the information access monitoring unit 102, acquires a page from an access destination included in the information acquisition start information, and extracts a main part of the page. The information extraction unit 103 generates display information including the main part of the page and outputs it to the information amount determination unit 104. The process of OP21 is the process of OP13 shown in FIG. Next, the process proceeds to OP22.

  In OP22, the information amount determination unit 104 receives input of display information from the information extraction unit 103, and determines the information amount of the main part of the page included in the display information. The information amount determination unit 104 outputs the information amount information to the browsing time estimation unit 107. The process of OP22 is the process of OP14 shown in FIG. Next, the process proceeds to OP23.

  In OP23, the browsing time estimation unit 107 compares the information amount information input from the information amount determination unit 104 with the browsing time history information stored in the expected browsing time information DB 108. Next, the process proceeds to OP24.

  In OP24, the browsing time estimation unit 107 determines the browsing time of the data having the information amount closest to the information amount included in the information amount information as the expected browsing time. The browsing time estimation unit 107 generates predicted browsing time information including the predicted browsing time, and outputs it to the browsing enabled state determination unit 110. Thereafter, the process shown in FIG. 6 ends.

  FIG. 7 is an example of a flowchart of display timing determination processing. The flowchart shown in FIG. 7 is started, for example, when the portable terminal 1 is activated, and is repeatedly executed while the portable terminal 1 is activated.

  In OP31, the display timing determination unit 113 receives input of display permission information from the viewable state determination unit 110. Next, the process proceeds to OP32.

  In OP32, the display timing determination unit 113 determines whether or not the number of notifications is recorded in the timing learning information DB 112. The number of notifications is not recorded in the initial state. If the number of notifications is not recorded (OP32: NO), the process proceeds to OP34. In OP34, the display timing determination unit 113 generates display timing information to which no re-notification information is added, and outputs the display timing information to the display information determination unit 114. Next, the process proceeds to OP35.

  If the number of notifications is recorded (OP32: YES), the process proceeds to OP33. In OP <b> 33, the display timing determination unit 113 generates display timing information by adding re-notification information, and outputs the display timing information to the display information determination unit 114. Next, the process proceeds to OP35.

  In OP35, the display timing determination unit 113 adds 1 to the number of notifications in the timing learning information DB 112. Next, the process proceeds to OP36.

  In OP36, the display timing determination unit 113 determines whether or not the number of notifications is greater than M. M is the upper limit number of notifications of display timing information to which re-notification information is added, and is an integer of 1 or more. If the number of notifications is greater than M (OP36: YES), the process proceeds to OP39. In this case, since the notification of the display timing information to which the re-notification information is added has reached the upper limit number, in OP39, the display timing determination unit 113 resets the notification number. Thereafter, when the process returns to OP31 and the display permission information is input again, the display timing information to which the re-notification information is not given is output to the display information determination unit 114, and the viewing suspension information different from the previous time is displayed. As determined.

  When the number of notifications is M or less (OP36: NO), the notification of the display timing information to which the re-notification information is added has not reached the upper limit number, and the process proceeds to OP37.

  In OP37, the display timing determination unit 113 determines whether or not the display result selection information is input from the display result selection reflection unit 116. If there is input of display result selection information (OP37: YES), the process proceeds to OP39. In this case, since there is a response to the display timing information, the display timing determination unit 113 resets the number of notifications. Thereafter, the process proceeds to OP31, and when display permission information is input, the processes of OP31 to OP39 are performed again.

  If there is no input of display result selection information (OP37: NO), the process proceeds to OP38. In OP38, the display timing determination unit 113 determines whether or not a predetermined time has elapsed since the notification of the display timing information. If the predetermined time has not elapsed since the notification of the display timing information (OP38: NO), the process returns to OP37. When a predetermined time has elapsed since the notification of the display timing information (OP38: YES), the process proceeds to OP33, and the display timing determination unit 113 generates the display timing information by adding the re-notification information, and the display information determination unit To 114. Thereafter, the processes of OP35 to OP38 are executed.

  The flowchart shown in FIG. 7 is an example, and the display timing determination process is not limited to the flowchart shown in FIG. For example, the processing order of OP37 and OP38 may be reversed.

  FIG. 8 is an example of a flowchart of the process for determining the viewing hold information to be displayed. The flowchart shown in FIG. 8 is started, for example, when the portable terminal 1 is activated, and is repeatedly executed during activation of the portable terminal 1.

  In OP41, the display information determination unit 114 receives the display timing information from the display timing determination unit 113. Next, the process proceeds to OP42.

  In OP42, the display information determination unit 114 determines whether re-notification information is added to the display timing information. If re-notification information is added to the display timing information (OP42: YES), the process proceeds to OP43. In OP43, the display information determination unit 114 determines the same viewing hold information as the display target that is determined when the previous display timing information is input as the display target. Next, the process proceeds to OP45.

  If re-notification information is not added to the display timing information (OP42: NO), the process proceeds to OP44. In OP <b> 44, the display information determination unit 114 determines, as a display target, browsing hold information that is different from the display target browsing hold information that was determined when the previous display timing information was input. Next, the process proceeds to OP45.

  In OP <b> 45, the display information determination unit 114 generates display target information including the determined viewing suspension information of the display target and outputs the display target information to the display unit 117. Thereafter, the process shown in FIG. 8 ends.

<Operational effects of the first embodiment>
In the first embodiment, the mobile terminal 1 presents information at a timing that is easy for the user to accept by detecting the state in which the user is zapping and presenting information stored for later viewing. Can do. Thereby, the possibility that the presented information is browsed by the user can be increased. In addition, since the user is provided with the browsing suspension information at a timing at which information can be easily accepted without setting a schedule for presenting information, the user's trouble can be reduced. Therefore, according to 1st Embodiment, the information preserve | saved for browsing later can be provided efficiently to a user.

<Modification of display processing>
When the user's viewable state is detected, the display unit 117 according to the first embodiment presents the viewing hold information determined as the display target by, for example, pop-up or screen transition to the viewing hold information page. It was. Instead of this, display processing may be performed as follows.

  For example, when viewing hold information is displayed in a pop-up, the user's awareness can be drawn. However, the reading suspension information is not information with high urgency or priority so that the user's awareness is projected from other information. Therefore, in this modification, the browsing suspension information is presented without any sense of incongruity along with the information presented by the application.

  FIG. 9 is a diagram illustrating an example of a method of presenting browsing suspension information according to a modification. The screen example shown in FIG. 9 is an article list screen of a news article browsing application. On the article list screen, multiple articles are listed.

  In the modified example, the mobile terminal 1 extracts a predetermined screen on which a plurality of pieces of information such as an article list are enumerated, and inserts and presents the viewing suspension information so as to be enumerated with other information on the predetermined screen. To do.

  FIG. 10A is a diagram illustrating an example of a functional configuration of the mobile terminal 1 according to the display process of the present modification. In FIG. 10A, the functional configuration related to the display process of the mobile terminal 1 is extracted and shown, and although not shown, the mobile terminal 1 also has the functional configuration shown in FIG. 3.

  In the present modification, the storage unit 12 stores a display processing program. The display processing program reconstructs the image data by inserting, for example, the viewing suspension information notified from the viewing suspension information display program into the image data written by the application as notification information, and displays the reconstructed image data. 14 is a program to be displayed on the screen. Hereinafter, information notified from other applications including the viewing suspension information display program, which is inserted into the image data written by the application by the display processing program, will be referred to as notification information.

  Normally, image data from an application is written to a frame buffer and drawn on the display 14. The frame buffer is a memory that is a part of the RAM 12B and is used for transferring an image from the application to the display 14. However, in the display processing program of this modification, a drawing buffer of the display 14 is prepared in addition to the frame buffer, and a process of adding notification information to the image data written to the frame buffer is performed. Then, the processed image data is written into a drawing buffer of the display 14 newly prepared. The display processing program is middleware corresponding to any application, for example.

  As a functional configuration according to this modification, the mobile terminal 1 includes a display information determination unit 114, a display unit 117, a display result selection reflection unit 116, a screen reconstruction unit 34, and a user operation determination unit 35. The display information determination unit 114, the display unit 117, and the display result selection reflection unit 116 are functions realized by the CPU 11 executing the browsing suspension information display program. The processing of the display information determination unit 114 and the display result selection reflection unit 116 is the same as that in the first embodiment.

  The display unit 117 includes a notification display request unit 31, a user operation registration unit 32, and a notification display unit 33. The notification display request unit 31 receives the display target information including the display hold information to be displayed from the display information determination unit 114, and displays the display request information including the view hold information as the notification information to the screen reconstruction unit 34. Output. Further, the notification display request unit 31 receives, from the user operation determination unit 35 described later, input of in-region operation information indicating the occurrence of a user operation on the display region of the notification information, and display end information including a notification information display end instruction Is output to the screen reconstruction unit 34.

  The user operation registration unit 32 receives an input of display area information including information on an area where the notification information is arranged from the screen reconstruction unit 34, so that a user operation on the area can be processed by a viewing suspension information display program or the like. The notified area is registered in a memory referred to by a user operation determination unit 35 described later.

  The notification display unit 33 receives in-region operation information indicating the occurrence of a user operation for the region registered by the user operation registration unit 32 from the user operation determination unit 35, and generates display result selection information for the displayed notification information. Then, the result is output to the display result selection reflection unit 116.

  The screen reconstruction unit 34 is a function realized when the CPU 11 executes a display processing program. The screen reconstruction unit 34 reconstructs image data by inserting notification information into the image data written to the frame buffer by the application. Details of the screen reconstruction unit 34 will be described later.

  The user operation determination unit 35 is, for example, one of OS functions. The user operation determination unit 35 receives input from the touch panel 13 and detects a user operation from the coordinate input on the touch panel 13. The detected user operation is, for example, tap, swipe, flick or the like. The user operation determination unit 35 determines whether or not a user operation has occurred within the area registered by the user operation registration unit 32. When the user operation indicated by the user operation information is generated in the area registered by the user operation registration unit 32, the operation information in the area is generated, and the notification display unit 33 and the notification display of the display unit 117 are displayed. Output to the request unit 31.

  FIG. 10B is a diagram illustrating a functional configuration example of the screen reconstruction unit 34. The screen reconstruction unit 34 includes a notification display determination unit 21, a screen configuration extraction unit 22, a design extraction unit 23, a notification content creation unit 24, a screen adjustment unit 25, a screen display synthesis unit 26, a screen generation unit 27, and a display processing unit 28. , A display area notification unit 29. In addition, an area used as a memory or buffer for each processing unit is secured in the RAM 12B.

  The screen display requesting unit 30 is, for example, one of the functions of an application for browsing news articles, and requests the display 14 to draw the image data by writing the image data in the frame buffer.

  The notification display determination unit 21 receives display request information input from the notification display request unit 31 and determines display of notification information included in the display request information. When receiving the display request information, the notification display determination unit 21 stores the display request information in the memory for the notification display determination unit 21. When receiving the display end information from the notification display request unit 31, the notification display determination unit 21 stores the memory. The display request information is deleted from.

  When the display request information from the notification display request unit 31 is not held in the memory, the notification display determination unit 21 writes the image data written in the frame buffer by the application into the buffer for the screen generation unit 27, A drawing request is sent to the screen generator 27. Further, when the display request information from the notification display request unit 31 is held in the memory, the notification display determination unit 21 instructs the screen configuration extraction unit 22 to perform drawing.

  The screen configuration extraction unit 22 and the design extraction unit 23 perform a design extraction process on the image data written in the frame buffer. Further, the notification content creation unit 24, the screen adjustment unit 25, and the screen display synthesis unit 26 create the image data of the notification information by applying it to the design of the image data written in the frame buffer, and write it out to the frame buffer. A screen reconstruction process for reconstructing the image data by combining the image data and the image data of the notification information is performed. Details of the design extraction process and the screen reconstruction process will be described later.

  The screen generation unit 27 requests the display processing unit 28 to draw the image data written in the buffer for the screen generation unit 27. The buffer for the screen generation unit 27 stores image data written from the application to the frame buffer or image data written from the screen display synthesis unit 26. The display processing unit 28 executes a drawing process for image data stored in the buffer for the screen generation unit 27.

  The display area notification unit 29 generates display area information including the display area of the notification information determined by the screen adjustment unit 25 and outputs the display area information to the user operation registration unit 32.

  FIG. 11 is a diagram illustrating an example of the design extraction process. In the design extraction processing, processing is performed in the order of (1) positional relationship, screen configuration extraction processing, and (2) design extraction processing from the image data written in the frame buffer.

  (1) The positional relationship of the image data and the screen configuration extraction process are performed by the screen configuration extraction unit 22. The screen configuration extraction unit 22 copies the frame buffer to the buffer for the screen configuration extraction unit 22. The screen configuration extraction unit 22 has a plurality of buffers, and holds a plurality of continuous image data written in the frame buffer in the plurality of buffers. The screen configuration extraction unit 22 obtains a changed area by taking a difference from the previous image data, and extracts the area as a displayable area where notification information can be arranged. For example, a scrollable region or a region that is not a frame is extracted from the region extracted as the displayable region by the screen configuration extraction unit 22. In addition, the screen configuration extraction unit 22 extracts the number of article display columns included in the displayable area. The article display column is a column in which, for example, the title of one article, a part of the article from the beginning of the body, etc. is displayed.

  (2) The design extraction unit 23 performs image data design extraction processing. The design extraction unit 23 copies the buffer storing the latest image data in the buffer of the screen configuration extraction unit 22 to the buffer for the design extraction unit 23, and extracts the design of the article display column in the displayable area. The design includes, for example, the character size of the article title, the display content, the character size of the body text, the character color, the font, and the background color. These are acquired by, for example, OCR (Optical Character Recognition) processing.

  FIG. 12 is a diagram illustrating an example of the screen reconstruction process. In the screen reconstruction processing, processing is performed in the order of (1) notification content display creation processing, (2) article position adjustment processing, and (3) screen display composition processing.

  (1) The notification content creation unit 24 performs the notification content display creation processing. The notification content creation unit 24, for example, displays the viewing-holding information of the display target input from the display information determination unit 114 so as to fit in one of the article display fields in the displayable area according to the design extracted by the design extraction process. The image data indicating is generated. The created data is stored in a buffer for the notification content creation unit 24.

  (2) The article position adjustment process is performed by the screen adjustment unit 25. The screen adjustment unit 25 arranges the image data of the notification information created by the notification content creation unit 24 in one of the article display fields in the displayable area in the image data, and resets the screen configuration. The resetting of the screen configuration is performed based on the screen configuration information extracted by the screen configuration extraction unit 22, for example. If there is an article that is hidden when the image data of the notification information is arranged in the displayable area, the screen adjustment unit 25 adjusts the position of the article, for example, by shifting the data of the hidden article To do.

  (3) The screen display composition process is performed by the screen display composition unit 26. The screen display synthesis unit 26 synthesizes the image data stored in the frame buffer and the image data of the notification information according to the screen configuration reset by the screen adjustment unit 25. The combined image data is passed to the screen generation unit 27.

  If the display request information including the notification information is not held, the notification display determination unit 21 writes the image data stored in the frame buffer to the buffer for the screen generation unit 27 and draws it on the screen generation unit 27. Make a request.

  FIG. 13 is a diagram illustrating an example of information handled by the screen reconstruction unit 34 in the modified example. In FIG. 13, information handled by the screen reconstruction unit 34 when processing is performed on the image data 50 is displayed. The screen 50 shows the image data after the notification information is inserted. “Notification content” in the screen 50 indicates that notification information included in the display request information input from the notification display request unit 31 is arranged. The notification information illustrated in FIG. 13 is an example of notification information included in the display request information input from the notification display request unit 31.

  The screen configuration information is information extracted by the screen configuration extraction unit 22 from the image data stored in the frame buffer. The screen configuration information includes, for example, coordinate information of a displayable area, the number of article display fields, a display article ID, and the like.

  The display article information and the article display column design information are information extracted by the design extraction unit 23 from the image data stored in the frame buffer. The display article information includes the arrangement order of articles included in the displayable area. The article display field design information includes, for example, the size of the area of the article display field, information included in one article display field, the arrangement position of the information, background image data, character size, font, and the like.

  The screen adjustment unit 25 performs the above-described article position adjustment processing based on the screen configuration information and the display article information. As a result of the article position adjustment process, when the display article or the article arrangement is changed, the screen adjustment unit 25 updates the screen configuration information and the display article information. The screen configuration information and the displayed article information shown in FIG. 13 are shown after being updated by the screen adjustment unit 25. The notification content creation unit 24 creates image data of the notification information according to the notification information and the article display field design information.

Notification information, display article information, screen configuration information, article display field design information are, for example, RAM
It is stored in the memory for the screen reconstruction unit 34 in 12B. In addition, the notification information in the memory for the screen reconstruction unit 34 is overwritten whenever the notification information indicated by the display request information changes, for example. Display article information, screen configuration information, and article display field design information are overwritten each time the design extraction process is executed.

<Process flow>
FIG. 14 is an example of a flowchart of processing of the notification display determination unit 21. The flowchart shown in FIG. 14 is executed each time image data is written into the frame buffer, for example.

  In OP51, the display notification determination unit 21 determines whether the display request information from the notification display request unit 31 is retained. If display request information is held (OP51: YES), the process proceeds to OP52. In OP52, the display notification determination unit 21 makes a drawing request to the screen configuration extraction unit 22. Thereafter, the process shown in FIG. 14 ends.

If the display request information is not held (OP51: NO), the process proceeds to OP53.
In OP53, the notification display determination unit 21 writes the image data written in the frame buffer by the application to the buffer for the screen generation unit 27 and makes a drawing request. Thereafter, the process shown in FIG. 14 ends.

  FIG. 15 is an example of a flowchart of processing of the screen configuration extraction unit 22. The process illustrated in FIG. 15 is started when the screen configuration extraction unit 22 receives a drawing request from the notification display determination unit 21.

  In OP61, the screen configuration extraction unit 22 copies the frame buffer to the buffer for the screen configuration extraction unit 22. Next, the process proceeds to OP62.

  In OP62, the screen configuration extraction unit 22 extracts a displayable area from the image data in the buffer. If a displayable area is extracted (OP62: YES), the process proceeds to OP63. In this case, the displayable area is stored in the buffer for the screen configuration extraction unit 22. If the displayable area is not extracted (OP62: NO), the process shown in FIG. 15 is terminated, and the notification information is not displayed.

  In OP63, the screen configuration extraction unit 22 extracts the article display column from the displayable area. When the article display column is extracted (OP63: YES), the process proceeds to OP64. If the article display column is not extracted (OP63: NO), the processing shown in FIG. 15 is terminated, and the notification information is not displayed.

  In OP64, the screen configuration extraction unit 22 extracts the number of article display columns included in the displayable area. In OP65, the screen configuration extraction unit 22 assigns an article display column ID to each article display column. Next, the process proceeds to OP66. For example, information stored in the screen configuration information shown in FIG. 13 is extracted by the processing of OP62 to OP65.

  In OP 66, the screen configuration extraction unit 22 passes the extracted displayable area information (for example, screen configuration information) to the design extraction unit 23. Thereafter, the process shown in FIG. 15 ends.

  FIG. 16 is an example of a flowchart of processing of the design extraction unit 23. The process illustrated in FIG. 16 is started when the design extraction unit 23 receives a notification of displayable area information from the screen configuration extraction unit 22.

  In OP71, the design extraction unit 23 copies the buffer for the screen configuration extraction unit 22 to the buffer for the design extraction unit 23. Next, the process proceeds to OP72.

  In OP72, the design extraction unit 23 extracts the size of each article display column. In OP73, the design extraction unit 23 extracts the background color in each article display column. In OP74, the design extraction unit 23 extracts the components in each article display column and the arrangement of the components. The constituent elements in the article display column are, for example, article titles, article body outlines, images, and the like. In OP75, the design extraction unit 23 estimates a design related to characters such as character size, font, and character color in the article display field. Next, the process proceeds to OP76. By the processing of OP72 to OP75, for example, information stored in the display article information and article display column design information shown in FIG. 13 is extracted.

  In OP76, the design extraction unit 23 calls the notification content creation unit 24. Thereafter, the processing shown in FIG. 16 ends.

The flowchart shown in FIG. 16 is an example, and the process of the design extraction unit 23 is not limited to the flowchart shown in FIG. For example, the execution order of the processes of OP72 to OP75 may be any.

  FIG. 17 is an example of a flowchart of processing of the notification content creation unit 24. The process shown in FIG. 17 is started when the notification content creation unit 24 is called by the design extraction unit 23.

  In OP81, the notification content creation unit 24 applies the design of the article display field and creates image data for displaying the notification information so as to fit in one of the article display fields. For example, the notification content creation unit 24 creates image data for displaying the notification information in accordance with the screen configuration information, display article information, and article display field design information shown in FIG. Next, the process proceeds to OP82.

  In OP 82, the notification content creation unit 24 passes the created image data of the notification information to the screen adjustment unit 25. Thereafter, the process shown in FIG. 17 ends.

  FIG. 18 is an example of a flowchart of processing of the screen adjustment unit 25. The flowchart shown in FIG. 18 is started when image data of notification information is passed from the notification content creation unit 24 to the screen adjustment unit 25.

  In OP91, the screen adjustment unit 25 determines whether the image data arrangement setting of the notification information is within the displayable area. The location of the image data of the notification information may be determined in advance by the user of the mobile terminal 1 or the designer of the display processing program. Alternatively, the setting of the arrangement location of the image data of the notification information may not be determined in advance.

  If the setting of the image data arrangement of the notification information is within the displayable area (OP91: YES), the process proceeds to OP92. Even when the image data arrangement of the notification information is not set, the process proceeds to OP92.

  In OP92, the screen adjustment unit 25 extracts the article display field ID corresponding to the setting of the image data arrangement of the notification information, and determines the insertion position of the image data of the notification information. If the setting of the image data of the notification information is not set, for example, the screen adjustment unit 25 randomly determines the insertion location of the image data of the notification information from the article display column. Next, the process proceeds to OP93.

  In OP93, the screen adjustment unit 25 displays the image data of the notification information in the article display field of the article display field ID determined in OP92. In OP94, the screen adjustment unit 25 displays, for example, the image data of an article hidden by the image data of the notification information in the overlay display and the image data of the article arranged below the image data of the article, one by one below. Set to display in the article display column. Next, the process proceeds to OP95.

  In OP91, when the setting of the image data arrangement of the notification information is outside the displayable area (OP91: NO), the process proceeds to OP98. In OP98, the screen adjustment unit 25 extracts the article display column ID of the lowest article display column in the displayable area. In OP99, the screen adjustment unit 25 displays the image data of the notification information in an overlay manner on the article display field of the article display field ID determined in OP98. Next, the process proceeds to OP95.

  In OP95, the screen adjustment unit 25 hides the image data of articles exceeding the displayable area and the image data of notification information. Next, the process proceeds to OP96.

  In OP96, the screen adjustment unit 25 updates the screen configuration information, display article information, and article display column design information shown in FIG. 13 with the screen configuration determined by OP91 to OP95, and the screen configuration display composition unit 26, for example. A new screen configuration. Upon receiving the new screen configuration, the screen configuration display composition unit 26 has written the notification information image data and the frame buffer in accordance with, for example, the screen configuration information, display article information, and article display column design information shown in FIG. The image data is combined with the image data to generate new image data, which is passed to the screen generation unit 27. Next, the process proceeds to OP97.

  In OP97, the screen adjustment unit 25 passes the area where the image data of the notification information is drawn to the display area notification unit 29. The display area notification unit 29 generates display area information including information on the drawing area of the notification information and notifies the user operation registration unit 32 of the display area information. Thereafter, the process shown in FIG. 18 ends.

  FIG. 19 is an example of a flowchart of processing of the user operation determination unit 35. The process shown in FIG. 19 is started by inputting coordinates by a user operation from the touch panel 13, for example.

  In OP101, the user operation determination unit 35 determines that the area where the tapping as one of the user operations is performed is in the area registered by the user operation registration unit 32, that is, in the image data drawing area of the notification information. It is determined whether or not. If the tapped area is within the area registered by the user operation registration unit 32 (OP101: YES), the process proceeds to OP102.

  In OP <b> 102, the user operation determination unit 35 generates in-region operation information for notifying the occurrence of a tap in the image data drawing region of the notification information, and notifies the notification display unit 33 and the notification display request unit 31. The notification display unit 33 that has received the operation information in the area executes a process according to the tap in the drawing area of the image data of the notification information, such as a transition to a screen showing the notification information. The notification display request unit 31 generates display end information that instructs the display end of the notification information, and outputs the display end information to the notification display determination unit 21. Thereafter, the process shown in FIG. 19 ends.

  In OP101, when the tapped area indicated by the user operation information is not within the area registered by the user operation registration unit 32 (OP101: NO), the process illustrated in FIG. 19 ends.

  When tapped in the image data drawing area of the article, the position of the image data of the article before insertion of the image data of the notification information may be notified to the application. Accordingly, for example, even when article data arranged below the insertion position of the image data of the notification information is tapped, the application can respond appropriately. This can be realized, for example, as follows.

  For example, when the user operation determination unit 25 detects that a tap has occurred outside the image data drawing area of the notification information in OP101, the user operation determination unit 35 displays the detected user operation information as a screen reconstruction unit. 34 is notified. The screen adjustment unit 25 of the screen reconstruction unit 34 adjusts the screen configuration information, display article information, and article display column design information shown in FIG. 13 with the screen before adjustment without updating the adjusted information. This information is retained for later screens. The screen reconstruction unit 34 further includes an application notification unit that notifies the application of the area where the tap has occurred.

The application notification unit receives input of user operation information of the tap other than the image data drawing area of the notification information from the user operation determination unit 35, and information included in the article display column corresponding to the tapped position is It is determined whether or not there is a change before and after adjustment by the screen adjustment unit 25. This determination is made based on, for example, display article information before and after adjustment by the screen adjustment unit 25.

  When the information included in the corresponding article display column of the tap position has not changed before and after adjustment by the screen adjustment unit 25, the application notification unit is notified of the tapped position from the user operation determination unit 25. Notify the application on the street. This is because it is indicated that the information included in the article display column has not been changed by the screen adjustment of the notification information insertion.

  When the information included in the corresponding article display column of the tap position has changed before and after adjustment by the screen adjustment unit 25, the application notification unit displays the tap position notified from the user operation determination unit 35, Make corrections in the article display area of the relevant article before adjustment and notify the application. More specifically, the application notification unit returns the position of the tap notified from the user operation determination unit 35 by the moving distance of the corresponding article by inserting the image data of the notification information (one article display column), Correct it. Accordingly, the application is notified of the tap position on the screen before the insertion of the image data of the notification information, and the application can appropriately perform the processing by the tap.

<Functional effects of modification>
In the modified example, the screen configuration and design of the image data written to the frame buffer by the application are extracted, and image data of the viewing suspension information as notification information is created according to the screen configuration and design, and is combined with the screen. To do. Thereby, the viewing suspension information can be presented to the user without causing a sense of incongruity without destroying the configuration and design of the screen of the original application.

  Since the display processing program is middleware that processes image data written in the frame buffer, the display processing program is not limited to the browsing suspension information display program of the first embodiment, and notification information from any application is displayed. It is possible. This can be realized by incorporating the function of the display unit 117 of the modification into the application, or by realizing the function of the display unit 117 of the modification as one application and using it together with the display processing program.

  In the modification, the notification display request unit 31 notifies the notification display determination unit 21 of the screen reconstruction unit 34 of the display end information in response to the input of the operation information in the area from the user operation determination unit 35. Instead, for example, the display information determination unit 114 notifies the notification display request unit 31 of a display end instruction for the browsing suspension information, and the notification display request unit 31 generates display end information in response to the display end instruction. The notification display determination unit 21 may be notified.

  For example, it is realizable as follows. Upon receiving the display result selection information from the notification display unit 33, the display result selection reflection unit 116 notifies the display timing selection unit 113 of the display result selection information. In response to this notification, the display timing determination unit 113 generates a display end instruction and notifies the display information determination unit 114 of it. Upon receiving this notification, the display information determination unit 114 notifies the notification display request unit 31 of a display end instruction.

<Others>
The above-described embodiment further discloses the following supplementary notes.
(Appendix 1)
A storage unit for holding predetermined information;
A detection unit for detecting a switching operation of a browsing target from an operation input;
A determination unit that determines the output of the predetermined information based on the relationship between the browsing objects switched by the switching operation;
An information processing apparatus comprising:
(Appendix 2)
A calculation unit that calculates a numerical value indicating the relationship between the browsing objects switched by the switching operation;
The determination unit determines the output of the predetermined information when it is determined that the relevance between the browsing objects is low based on the numerical value and a predetermined threshold.
The information processing apparatus according to attachment 1.
(Appendix 3)
The determination unit determines that the relevance between the browsing objects is low when the numerical value is smaller than the predetermined threshold.
The information processing apparatus according to attachment 2.
(Appendix 4)
The determination unit determines output of the predetermined information when an operation input for inputting information to the information processing apparatus is not performed for a predetermined time.
The information processing apparatus according to any one of appendices 1 to 3.
(Appendix 5)
The determination unit determines the output of the predetermined information when the browsing time of the browsing target switched by the switching operation is included in a browsing time range with respect to the amount of information included in the browsing target.
The information processing apparatus according to any one of appendices 1 to 4.
(Appendix 6)
A measuring unit for measuring the browsing time of each browsing target switched by the switching operation;
A second storage unit that holds the browsing time range according to the information amount based on the information amount of each browsing target output in the past and the measured browsing time of each browsing target;
Further comprising
The determination unit determines the output of the predetermined information using a browsing time range recorded in the second storage unit corresponding to the information amount of the browsing target switched by the switching operation.
The information processing apparatus according to appendix 5.
(Appendix 7)
The storage unit holds a plurality of predetermined information,
The information processing apparatus includes:
A determination unit that determines predetermined information to be displayed on the display device from the storage unit when output of the predetermined information is determined by the determination unit;
Further comprising
The determining unit determines, as information to be displayed on the display device, predetermined information different from the previous one when a predetermined condition is satisfied without browsing the determined predetermined information.
The information processing apparatus according to any one of appendices 1 to 6.
(Appendix 8)
The determining unit determines, as the predetermined condition, information to be displayed on the display device by predetermined information different from the previous time when a predetermined time has elapsed since the determination by the determination unit.
The information processing apparatus according to appendix 7.
(Appendix 9)
A reflection unit that stores the already-read information of the predetermined information in the storage unit when the determined predetermined information is browsed;
The information processing apparatus according to appendix 7 or 8, further comprising:
(Appendix 10)
A display processing unit for displaying the predetermined information on a display device;
An extraction unit for extracting a display screen image format of the display device;
Further comprising
The display processing unit arranges information related to the predetermined information held in the storage unit at a predetermined position of the display screen image according to the format of the extracted display screen image, and information related to the predetermined information Is displayed on the display device,
The information processing apparatus according to any one of appendices 1 to 9.
(Appendix 11)
A third storage unit that holds a display screen image written by an application that controls the browsing target for display on the display device;
A fourth storage unit for holding a display screen image read by the display device;
Further comprising
The extraction unit extracts a style from a display screen image held in the third storage unit,
The display processing unit creates a display screen image by arranging information on predetermined information held in the storage unit at a predetermined position of the display screen image according to the format of the extracted display screen image, Writing the created display screen image to the fourth storage unit to display information on the predetermined information on the display device;
The information processing apparatus according to attachment 10.
(Appendix 12)
An information processing apparatus including a storage unit that holds predetermined information
Detects the switching operation of the browsing target from the operation input,
An information processing method for determining output of the predetermined information based on relevance between browsing objects switched by the switching operation.
(Appendix 13)
An information processing apparatus that is connected to a display device and includes a storage unit that holds predetermined information.
Lets you detect the switching operation of the browsing target from the operation input,
The output of the predetermined information is determined based on the relationship between the browsing objects switched by the switching operation.
Information processing program.
(Appendix 14)
A display device;
A first storage unit for holding first screen data written by an application;
A second storage unit for holding second screen data read by the display device;
A combining unit configured to combine screen data in which predetermined image data is arranged at a predetermined position of the first screen data;
A screen generation unit that writes the combined screen data as the second screen data in the second storage unit and displays the predetermined image data on the display device;
An information processing apparatus comprising:
(Appendix 15)
An extraction unit for extracting a format of the first screen data;
A creation unit that creates the predetermined image data for displaying predetermined information according to the format;
Further comprising
The combining unit arranges the predetermined image data at the predetermined position of the first screen data according to the format, and combines the screen data.
The information processing apparatus according to appendix 14.
(Appendix 16)
The extraction unit extracts a displayable area in which the predetermined image data can be displayed from a difference between the first screen data continuously written in the first storage unit by the application,
The synthesizing unit synthesizes the screen data by arranging the predetermined image data at a predetermined position in the displayable area;
The information processing apparatus according to attachment 15.
(Appendix 17)
An adjustment unit that changes the arrangement of the partial image data when there is partial image data of the first screen data that is hidden by arranging the predetermined image data at the predetermined position;
The information processing apparatus according to any one of appendices 14 to 16, further comprising:
(Appendix 18)
A display device;
A first storage unit for holding first screen data written by an application;
A second storage unit for holding second screen data read by the display device;
An information processing apparatus comprising
Combining image data in which predetermined image data is arranged at a predetermined position of the first screen data;
Writing the combined screen data as the second screen data in the second storage unit, and displaying the predetermined image data on the display device;
Information processing method.
(Appendix 19)
A display device;
A first storage unit for holding first screen data written by an application;
A second storage unit for holding second screen data read by the display device;
In an information processing apparatus comprising
A predetermined image data is combined with screen data arranged at a predetermined position of the first screen data,
Writing the combined screen data as the second screen data in the second storage unit, and displaying the predetermined image data on the display device;
Information processing program.

DESCRIPTION OF SYMBOLS 1 Mobile terminal 21 Notification display determination part 22 Screen structure extraction part 23 Design extraction part 24 Notification content creation part 25 Screen adjustment part 26 Screen display composition part 27 Screen generation part 28 Display processing part 29 Display area notification part 31 Notification display request part 32 User operation registration unit 33 Notification display unit 34 Screen reconstruction unit 35 User operation determination unit 101 User operation detection unit 102 Information access monitoring unit 103 Information extraction unit 104 Information amount determination unit 105 Browsing time measurement unit 106 Browsing time information database 107 Browsing time Estimating unit 108 Expected browsing time information database 109 Relevance determining unit 110 Browsable state determining unit 111 Operation application detecting unit 112 Timing learning information database 113 Display timing determining unit 114 Display information determining unit 115 Browsing pending information database 116 Display result selection reflecting unit 117 Display

Claims (12)

A storage unit for holding predetermined information;
A detection unit for detecting a switching operation of a browsing target from an operation input;
A determination unit that determines the output of the predetermined information based on the relationship between the browsing objects switched by the switching operation;
An information processing apparatus comprising: A calculation unit that calculates a numerical value indicating the relationship between the browsing objects switched by the switching operation;
The determination unit determines the output of the predetermined information when it is determined that the relevance between the browsing objects is low based on the numerical value and a predetermined threshold.
The information processing apparatus according to claim 1. The determination unit determines output of the predetermined information when an operation input for inputting information to the information processing apparatus is not performed for a predetermined time.
The information processing apparatus according to claim 1 or 2. The determination unit determines the output of the predetermined information when the browsing time of the browsing target switched by the switching operation is included in a browsing time range with respect to the amount of information included in the browsing target.
The information processing apparatus according to any one of claims 1 to 3. A measuring unit for measuring the browsing time of each browsing target switched by the switching operation;
A second storage unit that holds the browsing time range according to the information amount based on the information amount of each browsing target output in the past and the measured browsing time of each browsing target;
Further comprising
The determination unit determines the output of the predetermined information using a browsing time range recorded in the second storage unit corresponding to the information amount of the browsing target switched by the switching operation.
The information processing apparatus according to claim 4. The storage unit holds a plurality of predetermined information,
The information processing apparatus includes:
A determination unit that determines predetermined information to be displayed on the display device from the storage unit when output of the predetermined information is determined by the determination unit;
Further comprising
The determining unit determines, as information to be displayed on the display device, predetermined information different from the previous one when a predetermined condition is satisfied without browsing the determined predetermined information.
The information processing apparatus according to any one of claims 1 to 5. The determining unit determines, as the predetermined condition, information to be displayed on the display device by predetermined information different from the previous time when a predetermined time has elapsed since the determination by the determination unit.
The information processing apparatus according to claim 6. A reflection unit that stores the already-read information of the predetermined information in the storage unit when the determined predetermined information is browsed;
The information processing apparatus according to claim 6 or 7, further comprising: A display processing unit for displaying the predetermined information on a display device;
An extraction unit for extracting a display screen image format of the display device;
Further comprising
The display processing unit arranges information related to the predetermined information held in the storage unit at a predetermined position of the display screen image according to the format of the extracted display screen image, and information related to the predetermined information Is displayed on the display device,
The information processing apparatus according to any one of claims 1 to 8. A third storage unit that holds a display screen image written by an application that controls the browsing target for display on the display device;
A fourth storage unit for holding a display screen image read by the display device;
Further comprising
The extraction unit extracts a style from a display screen image held in the third storage unit,
The display processing unit creates a display screen image by arranging information on predetermined information held in the storage unit at a predetermined position of the display screen image according to the format of the extracted display screen image, Writing the created display screen image to the fourth storage unit to display information on the predetermined information on the display device;
The information processing apparatus according to claim 9. An information processing apparatus including a storage unit that holds predetermined information
Detects the switching operation of the browsing target from the operation input,
Determining the output of the predetermined information based on the relationship between the browsing objects switched by the switching operation;
Information processing method. An information processing apparatus that is connected to a display device and includes a storage unit that holds predetermined information.
Lets you detect the switching operation of the browsing target from the operation input,
The output of the predetermined information is determined based on the relationship between the browsing objects switched by the switching operation.
Information processing program.