JP6439516B2 - Summary data generation program, summary data generation method, and summary data generation device - Google Patents

Description

  The present invention relates to a summary data generation program, a summary data generation method, and a summary data generation apparatus.

  In recent years, there is a service called Closed SNS (Social Networking Service) that is not premised on disclosure to a third party. In the closed SNS, limited members such as family members and friends can communicate with each other by writing messages and uploading images such as photos and videos.

  As the prior art, for example, additional information is acquired from a plurality of additional information based on the acquisition condition of additional information set for the marker detected from the captured image and the shooting state of the captured image, and the acquired additional information is acquired in the captured image. Some of them generate a composite image by compositing additional images according to information.

JP 2014-160963 A

  However, in the prior art, it takes time and effort to select a message related to an image uploaded to the SNS from a group of messages written in the same SNS. For example, in a service such as SNS, even if a comment is written on a certain photo, the photo is often not associated with the comment, and the user can check the content of the comment while checking the comment. Will be selected.

  In one aspect, the present invention provides a summary data generation program, a summary data generation method, and a summary data generation device that generate summary data in which character data related to image data is arranged in association with the image data. With the goal.

  According to one aspect of the present invention, the screen data displaying the received character data or image data in the order of reception time, regardless of the data reception corresponding to any user belonging to a specific user group, Provided in communications corresponding to users belonging to a specific user group, extract one or more image data from the received data, and receive it at a reception time close to each reception time of the one or more image data A summary data generation program, a summary data generation method, and a summary data generation apparatus that generate summary data in which each character data is arranged in association with each of the one or more image data are proposed.

  According to one aspect of the present invention, it is possible to generate summary data in which character data related to image data is arranged in association with the image data.

FIG. 1 is an explanatory diagram of an example of the summary data generation method according to the embodiment. FIG. 2 is an explanatory diagram illustrating a system configuration example of the system 200. FIG. 3 is a block diagram illustrating a hardware configuration example of the summary data generation apparatus 101. FIG. 4 is a block diagram illustrating a hardware configuration example of the terminal Ti. FIG. 5 is an explanatory diagram showing an example of the contents stored in the personal information management DB 220. FIG. 6 is an explanatory diagram showing an example of the contents stored in the SNS information DB 230. FIG. 7 is an explanatory diagram showing an example of the contents stored in the event management DB 240. FIG. 8 is an explanatory diagram showing an example of the contents stored in the album management DB 250. FIG. 9 is an explanatory diagram illustrating a screen example of the home screen S1. FIG. 10 is an explanatory diagram illustrating a screen example of the detailed setting screen 1000. FIG. 11 is a block diagram illustrating a functional configuration example of the summary data generation apparatus 101. FIG. 12 is an explanatory diagram (part 1) illustrating a screen example of the conversation screen S2. FIG. 13 is an explanatory diagram (part 2) illustrating a screen example of the conversation screen S2. FIG. 14 is an explanatory diagram showing a screen example of the album screen S3. FIG. 15 is an explanatory diagram of an example of updating material information. FIG. 16 is a flowchart illustrating an example of the summary data generation processing procedure of the summary data generation apparatus 101. FIG. 17 is a flowchart illustrating an example of a specific processing procedure of the material information creation processing.

  Exemplary embodiments of a summary data generation program, a summary data generation method, and a summary data generation apparatus according to the present invention will be described below in detail with reference to the drawings.

(One Example of Summary Data Generation Method)
FIG. 1 is an explanatory diagram of an example of the summary data generation method according to the embodiment. In FIG. 1, a summary data generation apparatus 101 is a computer that provides screen data in communication corresponding to users belonging to a specific user group. The terminal 102 is a computer used by users belonging to a specific user group, and is, for example, a smartphone, a tablet PC (Personal Computer), a PC, or a notebook PC.

  The specific user group is, for example, a user group to which a plurality of members who participate in a specific service belong. The specific service is information processing provided to the terminal 102, for example, a closed SNS that allows a limited member to communicate by posting messages, photos, videos, and the like. Examples of the closed SNS include a family-limited SNS, a close friend-limited SNS, a SNS limited to a member of a project, a SNS limited to a member of a certain group, and a SNS limited to a circle where people with the same hobbies and preferences gathered. .

  The screen data is screen data for displaying received character data or image data in order of reception time, regardless of data reception corresponding to any user belonging to a specific user group. The character data is, for example, character data of a message written in the closed SNS. The image data is, for example, image data such as a photograph or a movie uploaded to the closed SNS.

  Here, a summary in which one or more image data and character data related to each of the one or more image data are picked up from the character data group and the image data group received in communication corresponding to users belonging to a specific user group. You may want to create data. The summary data includes, for example, album data in which photos taken by family members and comments on the photos are posted, catalog data in which photos of products being developed in a project and comments of project members are posted.

  For example, it is assumed that album data of a family album is created using a photo and message uploaded to a family-limited SNS. At this time, when extracting photos uploaded to the SNS and manually adding comments to the extracted photos, the user must input the comments separately while checking the photos, creating album data Takes time and effort.

  On the other hand, when a photograph is uploaded to SNS or the like, a comment describing the impression of the photograph and the feeling at that time may be written. For this reason, for example, if you can pick up a photo that has been uploaded to a family-only SNS and a comment that describes the impression of the photo and the feelings at that time, the time and effort required to create the album data can be reduced. it can.

  However, in a service such as SNS, even if a comment for a certain photo is written, there is often no association between the photo and the comment. For this reason, the user selects a comment related to the photo while checking the content of the comment, and it still takes time and effort to create the album data.

  Therefore, in the present embodiment, a summary data generation method for reducing time and labor when creating a family album, a product catalog, and the like using image data of a photograph posted on an SNS or the like and text data of a message will be described. To do. Hereinafter, a processing example of the summary data generation apparatus 101 will be described. Here, a user group to which “member A”, “member B”, and “member C” participating in “friend-limited SNS” belong is assumed as a specific user group.

  (1) The summary data generation apparatus 101 provides screen data in communication corresponding to users belonging to a specific user group. In the example of FIG. 1, the summary data generation apparatus 101 displays the screen data 110 on the terminal 102 by transmitting the screen data 110 to the terminal 102 of the member participating in the friend-limited SNS.

  Here, the screen data 110 is screen data in which the character data 111 to 115 and the image data 116 and 117 received in communication corresponding to the members participating in the SNS limited to friends are displayed in the order of reception time.

  Specifically, the character data 111 is a message written by the member A to a friend-limited SNS. The character data 112 and 114 are messages written by the member C to a friend-limited SNS. The character data 113 and 115 are messages written by the member B to a friend-limited SNS. The image data 116 is a photograph uploaded by the member A to a friend-limited SNS. The image data 117 is a picture uploaded by a member C to a friend-limited SNS.

  The date and time corresponding to each character data 111 to 115 and each image data 116 and 117 indicates the reception time of each character data 111 to 115 and each image data 116 and 117. The reception time corresponds to, for example, the date and time when the character data 111 to 115 are written and the date and time when the image data 116 and 117 are uploaded.

  Here, it is assumed that the character data 111 is a message in which the feeling when the member A takes the image data 116 is described. Further, it is assumed that the character data 114 is a message in which an impression on the image data 117 captured by the member C is described.

  (2) The summary data generation apparatus 101 extracts one or a plurality of image data from the received data. Then, the summary data generation apparatus 101 converts each character data received at the reception time close to each reception time of the extracted one or more image data among the received data to each of the one or more image data. Generate summary data arranged in association with each other.

  Specifically, for example, the summary data generating apparatus 101 may extract all image data from the received data, or may extract image data designated by user operation input. The designation of the image data may be performed, for example, by designating the date or period when the image data is uploaded, or by designating the member who uploaded the image data.

  The character data received at the reception time close to the reception time of the image data may be, for example, character data received at a reception time within a predetermined time that is different from the reception time of the image data. The predetermined time can be arbitrarily set. For example, the predetermined time is set to about 5 to 30 minutes. Further, the character data received at the reception time close to the reception time of the image data may be, for example, character data received at the reception time immediately before or immediately after the reception time of the image data.

  In the example of FIG. 1, it is assumed that image data 116 and 117 are extracted from data received in communication corresponding to members A, B, and C. Further, the character data received at the reception time close to the reception time of the image data is set as the character data received at the reception time within a predetermined time from the reception time of the image data. The predetermined time is “T = 10 minutes”.

  In this case, the summary data generating apparatus 101 receives the received time (January 1, 2015) within 10 minutes of the time difference from the received time (January 1, 2015 00:03) of the image data 116 among the received data. The character data 111 received at 00:01 is extracted. In addition, the summary data generation device 101 receives the reception time (January 15, 2015) that is within 10 minutes of the received time of the image data 117 (January 15, 2015, 17:20) among the received data. The character data 114 received at 17:21 is extracted.

  The summary data generation apparatus 101 generates summary data 120 in which the character data 111 and 114 are arranged in association with the image data 116 and 117, respectively. In the example of FIG. 1, summary data 120 is generated in which the character data 111 and 114 are input to the balloons 121 and 122 corresponding to the image data 116 and 117, respectively.

  As described above, according to the summary data generating apparatus 101, the character data 111 and 114 received at the reception time close to the reception times of the image data 116 and 117 are arranged in association with the image data 116 and 117, respectively. The summary data 120 can be generated.

  As a result, for example, a message that is highly relevant to the photograph, such as the impression of the photograph uploaded to the SNS and the feeling at the time of photographing, can be arranged in association with the photograph. As a result, when creating a friend album or the like, it is possible to save the user from selecting a message related to a photo while checking the content of the message, and to save time and effort for creating the album.

(System configuration example of system 200)
Next, a system configuration example of the system 200 according to the embodiment will be described. In the following description, as a specific user group, a plurality of members who participate in a “family-oriented closed SNS” will be described as an example. Further, a family-oriented closed SNS may be simply referred to as “family-oriented SNS”.

  FIG. 2 is an explanatory diagram illustrating a system configuration example of the system 200. In FIG. 2, a system 200 is configured to include a summary data generation device 101 and terminals T1 to Tn (n is a natural number of 2 or more). In the system 200, the summary data generation apparatus 101 and the terminals T1 to Tn are connected via a wired or wireless network 210. The network 210 is, for example, a local area network (LAN), a wide area network (WAN), or the Internet.

  Here, the summary data generation apparatus 101 includes a personal information management DB (database) 220, an SNS information DB 230, an event management DB 240, and an album management DB 250, and performs display control of the terminals T1 to Tn. The summary data generation apparatus 101 is a server that provides a family-oriented SNS service, for example.

  For example, the summary data generation apparatus 101 provides screen data in communication corresponding to members who participate in a family-oriented SNS. The screen data is, for example, a screen that displays received character data or image data in the order of reception time (for example, a conversation screen to be described later), regardless of data reception corresponding to any member who participates in the family-oriented SNS. S2) information.

  The character data is, for example, character data of a message written in the family SNS. The image data is, for example, image data such as a photo or a video uploaded to the family-oriented SNS. The contents stored in the various DBs 220, 230, 240, and 250 will be described later with reference to FIGS.

  The terminals T1 to Tn are computers that have a display screen (for example, a display 406 shown in FIG. 4 to be described later) and can display various screens according to display control of the summary data generating apparatus 101. The terminals T1 to Tn are, for example, a smartphone, a tablet PC, a PC, a notebook PC, or the like used by the user.

  Specifically, for example, when the summary data generation apparatus 101 receives display requests for various screens (for example, a home screen S1 and a conversation screen S2 described later) from the terminals T1 to Tn, the summary data generation device 101 generates screen information for the various screens. To the terminals T1 to Tn. As a result, various screens are displayed on the display screens of the terminals T1 to Tn.

  In the following description, an arbitrary terminal among the terminals T1 to Tn may be expressed as “terminal Ti” (i = 1, 2,..., N).

(Example of hardware configuration of summary data generation apparatus 101)
FIG. 3 is a block diagram illustrating a hardware configuration example of the summary data generation apparatus 101. In FIG. 3, the summary data generating apparatus 101 includes a CPU (Central Processing Unit) 301, a memory 302, an I / F (Interface) 303, a disk drive 304, and a disk 305. Each component is connected by a bus 300.

  Here, the CPU 301 governs overall control of the summary data generation apparatus 101. The memory 302 includes, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), and a flash ROM. Specifically, for example, a flash ROM or ROM stores various programs, and a RAM is used as a work area for the CPU 301. The program stored in the memory 302 is loaded into the CPU 301 to cause the CPU 301 to execute the coded process.

  The I / F 303 is connected to the network 210 through a communication line, and is connected to another device (for example, the terminal Ti shown in FIG. 2) via the network 210. The I / F 303 controls an internal interface with the network 210 and controls input / output of data from other computers. For example, a modem or a LAN adapter may be employed as the I / F 303.

  The disk drive 304 controls reading / writing of data with respect to the disk 305 according to the control of the CPU 301. The disk 305 stores data written under the control of the disk drive 304. Examples of the disk 305 include a magnetic disk and an optical disk.

  The summary data generation apparatus 101 may include, for example, an SSD (Solid State Drive), a keyboard, a mouse, a display, and the like in addition to the above-described components.

(Example of hardware configuration of terminal Ti)
FIG. 4 is a block diagram illustrating a hardware configuration example of the terminal Ti. 4, the terminal Ti includes a CPU 401, a memory 402, a disk drive 403, a disk 404, an I / F 405, a display 406, and an input device 407. Each component is connected by a bus 400.

  Here, the CPU 401 controls the entire terminal Ti. The memory 402 includes, for example, a ROM, a RAM, a flash ROM, and the like. Specifically, for example, a flash ROM or ROM stores various programs, and the RAM is used as a work area of the CPU 401. The program stored in the memory 402 is loaded on the CPU 401 to cause the CPU 401 to execute the coded process.

  The disk drive 403 controls reading / writing of data with respect to the disk 404 according to the control of the CPU 401. The disk 404 stores data written under the control of the disk drive 403. Examples of the disk 404 include a magnetic disk and an optical disk.

  The I / F 405 is connected to the network 210 through a communication line, and is connected to another device (for example, the summary data generation device 101 shown in FIG. 2) via the network 210. The I / F 405 controls an internal interface with the network 210 and controls data input / output from other computers.

  The display 406 displays data such as a document, an image, and function information as well as a cursor, an icon, or a tool box. As the display 406, for example, a liquid crystal display, an organic EL (Electroluminescence) display, a CRT (Cathode Ray Tube), or the like can be adopted.

  The input device 407 has keys for inputting characters, numbers, various instructions, and the like, and inputs data. The input device 407 may be a keyboard or a mouse, or may be a touch panel type input pad or a numeric keypad.

  Note that the terminal Ti may not include the disk drive 403, the disk 404, and the like among the above-described components. Further, the terminal Ti may include, for example, an SSD, a scanner, and a printer in addition to the above-described components.

(Storage contents of various DBs 220, 230, 240, 250)
Next, the contents stored in the various DBs 220, 230, 240, 250 will be described with reference to FIGS. The various DBs 220, 230, 240, and 250 are realized by, for example, the memory 302 and the disk 305 of the summary data generation apparatus 101 illustrated in FIG.

<Storage contents of personal information management DB 220>
FIG. 5 is an explanatory diagram showing an example of the contents stored in the personal information management DB 220. In FIG. 5, the personal information management DB 220 has fields of family ID, personal ID, name, nickname, and face photograph, and by setting information in each field, personal information (for example, personal information 500-1 to 500-500). -5) is stored as a record.

  Here, the family ID is an identifier for uniquely identifying a family who uses the family-oriented SNS. The personal ID is an identifier that uniquely identifies a member who is a member of the family identified by the family ID. The name is the name of the member identified by the personal ID. The nickname is a member's nickname. The face photo is image data of the member's face photo.

  Although illustration is omitted, in the personal information management DB 220, for example, a member's gender, age, birthday, address, password, and desired items are registered in association with the personal ID.

<Storage contents of SNS information DB 230>
FIG. 6 is an explanatory diagram showing an example of the contents stored in the SNS information DB 230. In FIG. 6, the SNS information DB 230 has fields of family ID, personal ID, writing date / time, written content (text), and written content (image), and by setting information in each field, SNS information (for example, SNS information 600-1 to 600-4) is stored as a record.

  Here, the family ID is an identifier for uniquely identifying a family who uses the family-oriented SNS. The personal ID is an identifier that uniquely identifies a member who is a member of the family identified by the family ID. The date and time of writing is the date and time when the member identified by the personal ID wrote information to the family-oriented SNS. The written content (text) is character data of the message written by the member. The written content (image) is image data of a photo or video uploaded by the member.

<Storage contents of event management DB 240>
FIG. 7 is an explanatory diagram showing an example of the contents stored in the event management DB 240. In FIG. 7, the event management DB 240 has fields of event ID, family ID, personal ID, event date, event name, and details. By setting information in each field, event information (for example, event information 700- 1-700-3) are stored as records.

  Here, the event ID is an identifier for uniquely identifying the event registered by the member. The family ID is an identifier for uniquely identifying a family to which a member who is a registered person of the event belongs. The personal ID is an identifier for uniquely identifying a member who is a registered person of the event. The event date is the date on which the event is held. The event name is the name of the event. Details are details about the event.

<Storage contents of album management DB 250>
FIG. 8 is an explanatory diagram showing an example of the contents stored in the album management DB 250. In FIG. 8, the album management DB 250 has fields of family ID, album ID, writing date / time, shooting date, photo and comment, and by setting information in each field, material information (for example, material information 800-1). , 800-2) as a record.

  Here, the family ID is an identifier for uniquely identifying a family who uses the family-oriented SNS. The album ID is an identifier that uniquely identifies the family album identified by the family ID. The date and time of writing is the date and time when the photo included in the album identified by the album ID is uploaded to the family-oriented SNS.

  The shooting date is the date and time when the photograph was taken. In the initial setting, the date when the photograph is uploaded to the family-oriented SNS is set as the shooting date. The photo is image data of a photo included in the album. The comment is a comment added to the photo included in the album. In FIG. 8, a part of the comment is extracted and displayed.

(Example of home screen S1)
Next, a screen example of the home screen S1 displayed on the display 406 of the terminal Ti will be described.

  FIG. 9 is an explanatory diagram illustrating a screen example of the home screen S1. In FIG. 9, the home screen S1 is an operation screen displayed on the display 406 of the terminal Ti when logging into the family-oriented SNS. In the following description, a case where a tap operation is performed as an operation for the user to select a button or the like displayed on the operation screen will be described as an example.

  For example, when the button B1 is tapped by a user operation input using the input device 407 shown in FIG. 4 on the home screen S1, the operation screen can be switched to a greeting screen (not shown). The greeting screen is an operation screen that allows each member who is a member of the family ("Fujiya" in the example of FIG. 9) to input a daily greeting.

  In addition, when the button B2 is tapped by a user operation input on the home screen S1, the operation screen can be switched to the conversation screen S2 (for example, see FIGS. 12 and 13 described later). The conversation screen S2 is an operation screen that allows each member who is a member of the Fuji family to enter a message or upload an image to have a conversation between members.

  In the conversation screen S2, for example, when a message is input or an image is uploaded, the stored content of the SNS information DB 230 is updated.

  In addition, when the button B3 is tapped by a user operation input on the home screen S1, the operation screen can be switched to an event screen (not shown). The event screen is an operation screen on which each member who is a member of the Fuji family can register an event (event) related to the family.

  In the event screen, for example, when a new event is registered, the content stored in the event management DB 240 is updated.

  In addition, when the button B4 is tapped by a user operation input on the home screen S1, the operation screen can be switched to a family information screen (not shown). The family information screen allows you to view information about each member who is a member of the Fuji family (for example, age, birthday, address, password, what you want) and family albums, and to add / change information about each member. This is an operation screen that can be used.

  For example, when the member information is changed on the family information screen, the stored content of the personal information management DB 220 is updated.

  In addition, when the button B5 is tapped by a user operation input on the home screen S1, the operation screen can be switched to an inquiry screen (not shown). The inquiry screen is an operation screen that allows the administrator of the system 200 to make inquiries about opinions, requests, questions, etc. regarding the family-oriented SNS.

  On the home screen S1, when the button B6 is tapped by a user operation input, the operation screen can be switched to a face photo / nickname change screen (not shown). The face photo / nickname change screen is an operation screen that allows the face photo and nickname of each member who is a member of the Fuji family to be changed.

  In the face photo / nickname change screen, for example, when a member's face photo or nickname is changed, the stored contents of the personal information management DB 220 are updated.

  Further, when the button B7 is tapped by the user's operation input on the home screen S1, a detailed setting screen 1000 as shown in FIG. 10 described later is popped up, and then the album screen S3 (for example, see FIG. 14 described later). The operation screen can be switched to. The album screen S3 is an operation screen on which an album can be viewed and edited.

  In addition, the login process at the time of a member logging in to SNS for families is performed using personal ID and a password, for example. Specifically, for example, first, the summary data generating apparatus 101 receives authentication information from the terminal Ti. The authentication information includes, for example, a personal ID and a password that are input on a login screen (not shown) of the terminal Ti.

  Next, the summary data generation apparatus 101 authenticates the user of the terminal Ti based on the received authentication information. More specifically, for example, the summary data generation apparatus 101 refers to the personal information management DB 220 or the like and specifies a password corresponding to the personal ID included in the authentication information. Then, the summary data generating apparatus 101 collates the identified password with the password included in the authentication information.

  Then, the summary data generating apparatus 101 authenticates the user of the terminal Ti when the passwords match (authentication OK). On the other hand, when the passwords do not match, the summary data generation apparatus 101 does not authenticate the user of the terminal Ti (authentication NG). The summary data generating apparatus 101 does not authenticate the user of the terminal Ti even when the password corresponding to the personal ID included in the authentication information cannot be specified (authentication NG).

(Screen example of the detailed setting screen 1000)
Next, a screen example of the detailed setting screen 1000 pop-up displayed on the display 406 of the terminal Ti will be described.

  FIG. 10 is an explanatory diagram illustrating a screen example of the detailed setting screen 1000. 10, the detailed setting screen 1000 is an operation screen that pops up on the display 406 of the terminal Ti when the button B7 is tapped on the home screen S1 shown in FIG.

  For example, on the detailed setting screen 1000, when a button 1001 is tapped by a user operation input, it is possible to specify a period for which an album is to be created. As the target period, for example, all past periods, monthly units, year units, and the like can be designated. Note that when the button 1001 is tapped, an arbitrary period may be input as the target period.

  Further, on the detailed setting screen 1000, when a button 1002 is tapped by a user operation input, it is possible to specify which member will create an album for a photo uploaded by the member. As the target member, for example, the whole family, a specific member (for example, name, nickname) or the like can be designated.

  In addition, when a button 1003 is tapped by a user operation input on the detailed setting screen 1000, an event can be specified, and an album can be created for photos taken on the day the event is held. As the target event, for example, a family event registered on an event screen (not shown), or a general event such as New Year's Day, an adult day, or a hinamatsuri can be selected.

  Further, when a button 1004 is tapped on the detailed setting screen 1000, an album based on the result (target period, target member, target event) specified on the detailed setting screen 1000 can be generated. Further, when the button 1005 is tapped on the detailed setting screen 1000, the display of the detailed setting screen 1000 can be terminated.

(Functional configuration example of summary data generation apparatus 101)
FIG. 11 is a block diagram illustrating a functional configuration example of the summary data generation apparatus 101. In FIG. 11, the summary data generation apparatus 101 includes a reception unit 1101, a search unit 1102, a generation unit 1103, and a display control unit 1104. The receiving unit 1101 to the display control unit 1104 are functions as control units. Specifically, for example, by causing the CPU 301 to execute a program stored in a storage device such as the memory 302 and the disk 305 illustrated in FIG. Alternatively, the function is realized by the I / F 303. The processing result of each functional unit is stored in a storage device such as the memory 302 and the disk 305, for example.

  The accepting unit 1101 accepts a summary data generation request from any user belonging to a specific user group. A user belonging to a specific user group is, for example, any member who participates in a family-oriented SNS.

  Specifically, for example, when the button 1004 is tapped on the detailed setting screen 1000 as shown in FIG. 10, the accepting unit 1101 accepts an album generation request from the terminal Ti. The album generation request includes, for example, information on the target period, target member, and target event selected on the detailed setting screen 1000.

  In the following description, the user of the terminal Ti that has received the summary data generation request may be referred to as a “login person”.

  The search unit 1102 searches the SNS information DB 230 for SNS information corresponding to the login person's family ID. For example, the search unit 1102 can specify the family ID of the login person by specifying the family ID corresponding to the personal ID of the login person with reference to the personal information management DB 220.

  As an example, if the login person is a member P2 identified by the personal ID “P2”, the search unit 1102 searches the SNS information DB 230 for the SNS information corresponding to the login person's family ID “F1” (for example, the SNS information 600− 1 to 600-4).

  The generation unit 1103 generates summary data based on the searched SNS information. Specifically, for example, first, the generation unit 1103 acquires SNS information within a target period specified from information included in the album generation request from the searched SNS information. The SNS information within the target period is SNS information whose writing date / time is included in the target period.

  For example, when the target period is “all past periods”, the generation unit 1103 acquires all the searched SNS information. When the target period is “monthly”, the generation unit 1103 acquires SNS information for each month from the searched SNS information. If the target period is not specified, the generation unit 1103 may acquire all the searched SNS information.

  When the information about the target member is included in the album generation request, the generation unit 1103 determines the SNS within the target period of the target member specified from the information included in the album generation request from the searched SNS information. Information may be acquired. The SNS information of the target member is SNS information in which the personal ID of the target member is set. Note that the generation unit 1103 can specify the personal ID of the target member from information (for example, name, nickname, etc.) regarding the target member included in the album generation request with reference to the personal information management DB 220, for example.

  Thereby, an album can be generated for a photo uploaded to a family-oriented SNS by a specific member.

  When the information about the target event is included in the album generation request, the generation unit 1103 determines, based on the searched SNS information, the SNS within the target period of the target event specified from the information included in the album generation request. Information may be acquired. The SNS information of the target event is SNS information in which the event date of the target event is set as the writing date.

  Note that the generation unit 1103 can specify the event date of the target event from the information (for example, event name) regarding the target event included in the album generation request with reference to the event management DB 240, for example. For example, when the event name “amusement park” of the target event is included, the generation unit 1103 refers to the event information 700-1 of the event management DB 240 and identifies the event date “2015.2.08” of the target event. be able to. In addition, for a target event that is not registered in the event management DB 240, the generation unit 1103 refers to, for example, information storing a date on which a general event (for example, New Year's Day, Adult Day, Hina Matsuri, etc.) is held. The event date of the target event may be specified.

  Thereby, an album can be generated for the photos uploaded to the family-oriented SNS on the day when the family event is held.

  Then, the generation unit 1103 extracts first SNS information in which image data of a photograph (or moving image) is set in the writing content (image) field from the acquired SNS information within the target period. Next, the generation unit 1103 sets the character data of the message written at the writing date and time close to the writing date and time of the extracted first SNS information from the acquired SNS information within the target period in the writing content (text) field. The extracted second SNS information is extracted.

  Here, the writing date and time close to the writing date and time of the first SNS information is, for example, a writing date and time within a predetermined time T that is a time difference from the writing date and time of the first SNS information in which the image data of the photograph is set. . The predetermined time T can be arbitrarily set, and is set to a time of about 5 minutes to 30 minutes, for example.

  Also, the generation unit 1103 converts the SNS information satisfying the condition X among the SNS information in which the character data of the message written on the writing date and time close to the writing date and time of the first SNS information is set to the second SNS information. May be extracted. Here, the SNS information satisfying the condition X is SNS information corresponding to the same user as the user corresponding to the first SNS information.

  More specifically, the SNS information satisfying the condition X is SNS information in which the personal ID set in the personal ID field is the same as the first SNS information. In this case, the second SNS information is SNS information in which character data of a message written by the same user as the user who uploaded the photograph of the first SNS information is set.

  In addition, the generation unit 1103 converts the SNS information satisfying the condition Y among the SNS information in which the character data of the message written on the writing date and time close to the writing date and time of the first SNS information is set to the second SNS information. May be extracted. Here, the SNS information satisfying the condition Y corresponds to the same user as the user corresponding to the first SNS information and the character of the message written at the writing date and time closest to the writing date and time of the first SNS information. SNS information in which data is set. In this case, the second SNS information is a message text written by the same user as the user who uploaded the first SNS information photo immediately before or immediately after the date when the first SNS information photo was uploaded. SNS information including data is obtained.

  In the following description, the image data of a photo set in the writing content (image) field of the first SNS information extracted from the SNS information within the target period may be referred to as “image data of the target photo”. Further, the character data of the message set in the writing content (text) field of the second SNS information extracted from the SNS information within the target period may be referred to as “character data of the target message”.

  The generation unit 1103 creates material information that associates the extracted image data of the target photograph of the first SNS information with the character data of the extracted target message of the second SNS information. The material information includes the family ID of the log-in person, the date and time of writing the image data of the target photo, the shooting date, the image data of the target photo, and the character data of the target message. The shooting date is the date when the image data of the target photo is uploaded (the date of writing).

  Next, the generation unit 1103 assigns an album ID to the created material information and registers it in the album management DB 250. When the generation unit 1103 extracts a plurality of SNS information in which photo image data is set from the SNS information within the target period, the generation unit 1103 creates material information for each of the extracted plurality of SNS information and creates an album. Register in the management DB 250. At this time, the same album ID is assigned to each material information.

  Then, the generation unit 1103 generates, as summary data, album data in which the character data of the target message is arranged in association with the image data of the target photo. More specifically, for example, the generation unit 1103 refers to the album management DB 250 and sets the character data of the target message written at the writing date and time close to the writing date and time of the image data of one or more target photos to 1 Alternatively, album data arranged in association with each of the image data of a plurality of target photos is generated. An example of album data generation will be described later with reference to FIG.

  The display control unit 1104 performs control to display the generated summary data on the terminal Ti. Specifically, for example, the display control unit 1104 may control to display the album screen S3 of the generated album data on the display 406 of the terminal Ti that has received the album generation request.

  The album screen S3 is an operation screen that allows browsing and editing of album data. As a result, the user of the terminal Ti can browse and edit the family album on the album screen S3. A screen example of the album screen S3 will be described later with reference to FIG.

  The accepting unit 1101 may accept a summary data display request from any user belonging to a specific user group. Specifically, for example, the reception unit 1101 receives an album display request from the terminal Ti of any member participating in the family-oriented SNS.

  The album display request can be made, for example, on the family information screen (not shown) displayed when the button B4 is tapped on the home screen S1 shown in FIG. The album display request includes, for example, the album ID of the album requested to be displayed.

  When the generation unit 1103 receives a summary data display request, the generation unit 1103 generates summary data requested to be displayed. Specifically, for example, when receiving an album display request, the generation unit 1103 acquires material information corresponding to the album ID included in the album display request from the album management DB 250. Then, the generation unit 1103 generates album data of the album requested to be displayed based on the acquired material information.

  Further, the display control unit 1104 performs control to display the generated summary data on the terminal Ti that has received the summary data display request. Specifically, for example, the display control unit 1104 may perform control to display the album screen of the generated album data on the display 406 of the terminal Ti that has received the album display request. Thereby, the member who participates in SNS for families can browse a family album at arbitrary timing.

  The accepting unit 1101 may accept a summary data update request from any user belonging to a specific user group. Specifically, for example, the reception unit 1101 receives an album update request from the terminal Ti of any member participating in the family-oriented SNS.

  An album update request can be made, for example, by tapping a button 1432 on an album screen S3 as shown in FIG. The album update request includes, for example, information specifying the update contents of the album data. An example of updating the album data will be described later with reference to FIG.

  For example, when receiving an album update request, the generation unit 1103 updates the material information of the requested album. Specifically, for example, the generation unit 1103 updates the material information in the album management DB 250 based on the update contents of the album data specified from the album update request. An example of updating the material information will be described later with reference to FIG.

(Example of album screen)
Next, a screen example of the album screen displayed on the display 406 of the terminal Ti will be described. First, a screen example of the conversation screen S2 displayed on the terminal Ti will be described using FIG. 12 and FIG.

  12 and 13 are explanatory diagrams showing screen examples of the conversation screen S2. 12 and 13, a conversation screen S2 is an operation screen displayed on the display 406 of the terminal Ti when the button B2 is tapped on the home screen S1 shown in FIG.

  This conversation screen S2 is provided to each member's terminal Ti in communication corresponding to each member of the Fuji family participating in the family-oriented SNS. According to the conversation screen S2, a message written by each member who is a member of the Fuji family and an image uploaded by each member can be viewed.

  Specifically, the messages 1201 and 1202 are messages written in the family-oriented SNS by the member P1 (nickname: father). The message 1203 is a message written in the family-oriented SNS by the member P4 (nickname: grandma). The photograph 1204 is a photograph uploaded to the family-oriented SNS by the member P1 (nickname: father).

  Here, when the predetermined time T is “T = 10 minutes” and the target photo is a photo 1204 uploaded by the member P1 (nickname: dad), for example, the target message satisfying the above condition X is the member P1 (nickname). : Message 1202 written by Dad). The message 1202 describes a comment for the photograph 1204.

  In this case, the generation unit 1103 creates material information that associates the image data of the target photograph 1204 with the character data of the target message 1202. Then, the generation unit 1103 assigns the album ID “AL1” to the created material information and registers it in the album management DB 250 (for example, the material information 800-1 illustrated in FIG. 8).

  The message 1301 is a message written in the family-oriented SNS by the member P2 (nickname: mom). Messages 1302 and 1303 are messages written to the family-oriented SNS by member P4 (nickname: grandma). A photograph 1304 is a photograph uploaded to the family-oriented SNS by the member P2 (nickname: mom).

  Here, if the predetermined time T is “T = 10 minutes” and the target photo is a photo 1304 uploaded by the member P2 (nickname: mom), for example, the target message that satisfies the above condition X is the member P2 (nickname). : A message 1301 written by mother). The message 1301 describes a comment for the photograph 1304.

  In this case, the generation unit 1103 creates material information that associates the image data of the target photograph 1304 with the character data of the target message 1301. Then, the generation unit 1103 assigns the album ID “AL1” to the created material information and registers it in the album management DB 250 (for example, the material information 800-2 illustrated in FIG. 8).

  Further, the generation unit 1103 refers to the material information 800-1 and 800-2, and arranges album data in which the character data of the target messages 1202 and 1301 are arranged in association with the image data of the target photos 1204 and 1304, respectively. Generate. Then, the display control unit 1104 performs control to display the album screen S3 (see FIG. 14 described later) of the generated album data on the terminal Ti.

  FIG. 14 is an explanatory diagram showing a screen example of the album screen S3. In FIG. 14 (14-1), the album screen S3 is an operation screen in which comments 1403 and 1404 are arranged in association with the photos 1401 and 1402, respectively. A photograph 1401 corresponds to the target photograph 1204 illustrated in FIG. A photograph 1402 corresponds to the target photograph 1304 shown in FIG. The comment 1403 corresponds to the target message 1202 shown in FIG. The comment 1404 corresponds to the target message 1301 shown in FIG.

  Here, the comment 1403 arranged in association with the photo 1401 describes the situation in which the photo 1401 was taken and the impression of the photographer's photo 1401, and is appropriate as a comment for the photo 1401. Is added. A comment 1404 arranged in association with the photo 1402 describes the situation in which the photo 1402 was taken and information on the person shown in the photo 1402, and is appropriate as a comment for the photo 1402. Things have been added.

  Further, when the button 1410 is tapped by the user's operation input on the album screen S3, the photo 1401 and the comment 1403 can be deleted. Further, when the button 1411 is tapped by the user's operation input on the album screen S3, the content of the comment 1403 can be corrected. Further, when the button 1412 is tapped by the user's operation input on the album screen S3, the comment 1403 can be deleted.

  Further, when the button 1420 is tapped by the user's operation input on the album screen S3, the photo 1402 and the comment 1404 can be deleted. Further, when the button 1421 is tapped by the user's operation input on the album screen S3, the content of the comment 1404 can be corrected. Further, when the button 1422 is tapped by the user's operation input on the album screen S3, the comment 1404 can be deleted.

  Further, when the button 1431 is tapped by the user's operation input on the album screen S3, the display of the album screen S3 can be terminated. Further, when the button 1432 is tapped on the album screen S3, an update request for the album can be notified to the summary data generating apparatus 101.

  In the example shown in (14-2) of FIG. 14, the button 1411 is tapped and the content of the comment 1403 is corrected. Further, the button 1421 is tapped, and the content of the comment 1404 is corrected. In this case, when the button 1432 is tapped, an album update request including the contents of the modified comments 1403 and 1404 is notified to the summary data generating apparatus 101, and the material information 800-1 and 800 in the album management DB 250 is received. -2 is updated. An example of updating the material information will be described later with reference to FIG.

  In the album screen S3, the arrangement positions of the photos 1401 and 1402 can be arbitrarily set. For example, the photos with the oldest shooting dates may be arranged in order from the upper left of the screen. Furthermore, the arrangement positions of the photos 1401 and 1402 can be arbitrarily changed by user operation input. However, when the arrangement positions of the photos 1401 and 1402 are changed, the arrangement positions of the corresponding comments 1403 and 1404 are similarly changed. Also, the shooting dates of the photos 1401 and 1402 can be arbitrarily changed by selecting the date and time displayed on the top of the photos 1401 and 1402, for example.

  FIG. 15 is an explanatory diagram of an example of updating material information. In FIG. 15, the setting content of the comment field of the material information 800-1 is updated according to the content of the corrected comment 1403 shown in (14-2) of FIG. Further, the setting content of the comment field of the material information 800-2 is updated according to the content of the corrected comment 1404 shown in (14-2) of FIG.

  On the album screen S3, for example, when the button 1432 is tapped with the photo 1401 and the comment 1403 deleted, the material information 800-1 in the album management DB 250 is deleted. On the album screen S3, for example, when the button 1432 is tapped with the comment 1403 deleted, the comment field of the material information 800-1 in the album management DB 250 is initialized.

(Summary data generation processing procedure of summary data generation apparatus 101)
Next, the summary data generation processing procedure of the summary data generation apparatus 101 will be described.

  FIG. 16 is a flowchart illustrating an example of the summary data generation processing procedure of the summary data generation apparatus 101. In the flowchart of FIG. 16, first, the summary data generating apparatus 101 performs control to display the conversation screen S2 on the terminal Ti of the member who participates in the family-oriented SNS (step S1601).

  Next, the summary data generating apparatus 101 determines whether an album generation request is received from the terminal Ti (step S1602). Here, the summary data generation apparatus 101 waits to receive an album generation request (step S1602: No). When the summary data generation apparatus 101 receives an album generation request (step S1602: Yes), the summary data generation apparatus 101 searches the SNS information DB 230 for SNS information corresponding to the family ID of the login user (step S1603).

  Next, the summary data generation apparatus 101 acquires SNS information within the target period specified from the information included in the album generation request from the searched SNS information (step S1604). When the information about the target member is included in the album generation request, the summary data generating apparatus 101 acquires the SNS information of the target member within the target period from the searched SNS information. When the information about the target event is included in the album generation request, the summary data generating apparatus 101 acquires the SNS information of the target event within the target period from the searched SNS information.

  Next, the summary data generation device 101 selects unselected SNS information that has not been selected among the obtained SNS information within the target period (step S1605). Then, the summary data generating apparatus 101 determines whether or not photo image data is set in the selected SNS information (step S1606).

  Here, when the image data of the photograph is not set (step S1606: No), the summary data generating apparatus 101 proceeds to step S1608. On the other hand, when the image data of the photograph is set (step S1606: Yes), the summary data generating apparatus 101 executes a material information creation process (step S1607).

  A specific processing procedure of the material information creation processing will be described later with reference to FIG. In the following description, the SNS information selected in step S1605 (where SNS information is set with photo image data) may be referred to as “first SNS information”.

  Next, the summary data generation apparatus 101 determines whether there is unselected SNS information that is not selected among the SNS information within the target period (step S1608). Here, when there is unselected SNS information (step S1608: Yes), the summary data generating apparatus 101 returns to step S1605.

  On the other hand, when there is no unselected SNS information (step S1608: No), the summary data generation apparatus 101 generates album data with reference to the album management DB 250 (step S1609). Then, the summary data generation apparatus 101 performs control to display the album screen S3 of the generated album data on the terminal Ti (step S1610), and ends a series of processes according to this flowchart.

  As a result, album data S3 can be used to automatically generate album data based on photos uploaded by each member participating in the family-oriented SNS and written messages, and to view and edit family albums. Can be displayed on the terminal Ti.

  Next, a specific processing procedure of the material information creation processing in step S1607 shown in FIG. 16 will be described.

  FIG. 17 is a flowchart illustrating an example of a specific processing procedure of the material information creation processing. In the flowchart of FIG. 17, first, the summary data generating apparatus 101 determines the SNS information of a message in which the time difference from the writing date and time of the first SNS information from the SNS information in the target period is written at the writing date and time within the predetermined time T. Is extracted (step S1701).

  Then, the summary data generating apparatus 101 determines whether SNS information has been extracted (step S1702). When the SNS information is extracted (step S1702: Yes), the summary data generating apparatus 101 determines whether the extracted SNS information includes SNS information having the same personal ID as the first SNS information. Is determined (step S1703).

  Here, when there is SNS information having the same personal ID as the first SNS information (step S1703: Yes), the summary data generating apparatus 101 writes the first SNS with the writing date and time out of the SNS information having the same personal ID. The SNS information closest to the information writing date and time is specified as the second SNS information (step S1704).

  Next, the summary data generating apparatus 101 creates material information that associates the image data of the target photo of the first SNS information with the character data of the target message of the second SNS information (step S1705). The summary data generation apparatus 101 registers the created material information in the album management DB 250 (step S1706), and returns to the step that called the material information creation process.

  If no SNS information is extracted in step S1702 (step S1702: No), the summary data generating apparatus 101 creates material information including image data of a target photograph of the first SNS information (step S1707). ), The process proceeds to step S1706.

  In step S1703, if there is no SNS information having the same personal ID as the first SNS information (step S1703: No), the summary data generating apparatus 101 includes a material including image data of a target photograph of the first SNS information. Information is created (step S1707), and the process proceeds to step S1706.

  Thereby, it is possible to create material information in which image data of the target photograph is associated with character data of the target message. Further, when there is no target message, material information including image data of the target photo can be created.

  As described above, according to the summary data generation device 101 according to the embodiment, screen data of the conversation screen S2 can be provided in communication corresponding to members who participate in the family-oriented SNS. The screen data of the conversation screen S2 is information on a screen that displays received character data or image data in the order of reception time regardless of data reception corresponding to any member who participates in the family-oriented SNS.

  Thereby, the member who participates in SNS for families can write a message in conversation screen S2, or upload images, such as a photograph and a moving image, and can have a conversation between members.

  Moreover, according to the summary data generation device 101, one or a plurality of image data can be extracted from data received in communication corresponding to members who participate in the family-oriented SNS. The summary data generating apparatus 101 generates summary data in which each character data received at a reception time close to each reception time of the extracted image data is associated with each of the extracted image data. Can do.

  Thereby, it is possible to generate summary data in which a message that is highly related to a photo (or a moving image) uploaded to the family-oriented SNS is arranged in association with the photo.

  For example, in many cases, before and after the date and time when the photograph was uploaded, a message describing the impression of the photograph and feelings at the time of photographing is written. For this reason, a message written on the date and time close to the date and time when the photo was uploaded is placed in association with the photo, and comments that are likely to describe the impression of the photo and feelings at the time of shooting are added. Album data can be automatically generated. In addition, it is possible to make it easier to remember the situation at the time of shooting from the comment added to the photo. Furthermore, it is possible to reduce the time and effort required for creating an album as compared with a case where a comment is input separately while checking a photo.

  Further, according to the summary data generating apparatus 101, the summary data in which the character data corresponding to the same user as the user corresponding to the image data received at the reception time close to the reception time of the image data is arranged in association with the image data. Data can be generated.

  Thereby, the message written by the member who uploaded the photo can be arranged in association with the photo before and after the date and time when the photo was uploaded. For this reason, it is possible to generate summary data in which a message having a higher possibility of describing a feeling of a photograph and feelings at the time of photographing is arranged in association with the photograph.

  Further, according to the summary data generating apparatus 101, the character data received at the reception time closest to the reception time of the image data corresponding to the same user as the user corresponding to the image data is arranged in association with the image data. Summary data can be generated.

  Thereby, the message written by the member who uploaded the photo can be arranged in association with the photo immediately before or after the date when the photo was uploaded. Therefore, even if multiple messages were written by the member who uploaded the photo before and after the photo was uploaded, summary data in which messages that are more likely to be described about the photo were placed in association with the photo Can be generated.

  Further, according to the summary data generation device 101, when the designation of the target event is accepted, when extracting one or more image data from the received data, the one or more received on the event date of the designated event Image data can be extracted.

  This makes it possible to generate summary data for uploaded photos and written messages on the day the specified event is held, and for an event-specific album (for example, birthday-limited or adult-style only) Album).

  Further, according to the summary data generating apparatus 101, when the designation of the target member is accepted, when extracting one or more image data from the received data, the one or more image data uploaded by the designated member Can be extracted.

  Thereby, summary data can be generated for a photo uploaded by a designated member or a written message, and an album dedicated to a certain member (for example, an album of personal history) can be created.

  The summary data generation method described in this embodiment can be realized by executing a program prepared in advance on a computer such as a personal computer or a workstation. The summary data generation program is recorded on a computer-readable recording medium such as a hard disk, a flexible disk, a CD-ROM, an MO, and a DVD, and is executed by being read from the recording medium by the computer. The summary data generation program may be distributed via a network such as the Internet.

  The following additional notes are disclosed with respect to the embodiment described above.

(Supplementary note 1)
Regardless of the data reception corresponding to any user as long as the user belongs to a specific user group, the screen data displaying the received character data or image data in the order of reception time corresponds to the user belonging to the specific user group Provided in communication
Among the received data, one or more image data are extracted, and each character data received at a reception time close to each reception time of the one or more image data is assigned to each of the one or more image data. Generate summary data arranged in correspondence,
A summary data generation program characterized by causing a process to be executed.

(Additional remark 2) The said process to produce | generate is the same user as the user corresponding to said 1 or several image data among each character data received at the reception time close | similar to each reception time of said one or several image data. The summary data generation program according to appendix 1, wherein summary data is generated by arranging each corresponding character data in association with each of the one or more image data.

(Additional remark 3) The said process to produce | generate is the same user as the user corresponding to said 1 or several image data among each character data received at the reception time close | similar to each reception time of said one or several image data. Supplementary note 1 that generates summary data corresponding to each character data received at the reception time closest to each reception time and corresponding to each of the one or more image data The summary data generation program described.

(Supplementary Note 4) Each character data received at a reception time close to each reception time of the one or more image data is each character data received at a reception time within a predetermined time from the reception time. The summary data generation program according to any one of appendices 1 to 3, wherein:

(Supplementary note 5)
Execute the process that accepts the event specification,
The generating process extracts one or a plurality of image data received on a date on which the designated event is held when extracting one or a plurality of image data from the received data. The summary data generation program as described in any one of 1-4.

(Appendix 6)
Executing a process of accepting designation of at least one user belonging to the specific user group;
Any one of appendices 1-5, wherein the generating process extracts one or a plurality of image data corresponding to the designated user when extracting one or a plurality of image data from the received data. Summary data generation program according to any one of the above.

(Additional remark 7) The said specific user group is a user group to which the several member who participates in a specific service belongs, The summary data generation program as described in any one of Additional remarks 1-6 characterized by the above-mentioned.

(Appendix 8) The computer
Regardless of the data reception corresponding to any user as long as the user belongs to a specific user group, the screen data displaying the received character data or image data in the order of reception time corresponds to the user belonging to the specific user group Provided in communication
Among the received data, one or more image data are extracted, and each character data received at a reception time close to each reception time of the one or more image data is assigned to each of the one or more image data. Generate summary data arranged in correspondence,
A summary data generation method characterized by executing processing.

(Supplementary Note 9) Regardless of the data reception corresponding to any user belonging to a specific user group, screen data in which received character data or image data is displayed in the order of reception time is stored in the specific user group. Provided in communication corresponding to the user to which it belongs,
Among the received data, one or more image data are extracted, and each character data received at a reception time close to each reception time of the one or more image data is assigned to each of the one or more image data. Generate summary data arranged in correspondence,
A summary data generation device comprising a control unit.

101 Summary Data Generation Device 102, T1-Tn, Ti Terminal 200 System 220 Personal Information Management DB
230 SNS information DB
240 Event Management DB
250 Album management DB
1000 Detailed setting screen 1101 Reception unit 1102 Search unit 1103 Generation unit 1104 Display control unit S1 Home screen S2 Conversation screen S3 Album screen

Claims (6)

On the computer,
Regardless of the data reception corresponding to any user as long as the user belongs to a specific user group, the screen data displaying the received character data or image data in the order of reception time corresponds to the user belonging to the specific user group Provided in communication
Among the received data, one or more image data are extracted, and each character data received at a reception time close to each reception time of the one or more image data is assigned to each of the one or more image data. Generate summary data arranged in correspondence,
A summary data generation program characterized by causing a process to be executed. The process to generate is
Of the character data received at the reception time close to the reception times of the one or more image data, the character data corresponding to the same user as the user corresponding to the one or more image data is the 1 or The summary data generation program according to claim 1, wherein summary data arranged in association with each of a plurality of image data is generated. The process to generate is
Among character data received at a reception time close to each reception time of the one or more image data, corresponds to the same user as the user corresponding to the one or more image data, and at each reception time. The summary data generation program according to claim 1, wherein summary data is generated by arranging each character data received at the nearest reception time in association with each of the one or more image data.   Each character data received at a reception time close to each reception time of the one or more image data is each character data received at a reception time within a predetermined time with a time difference from each reception time. The summary data generation program according to any one of claims 1 to 3. Computer
Regardless of the data reception corresponding to any user as long as the user belongs to a specific user group, the screen data displaying the received character data or image data in the order of reception time corresponds to the user belonging to the specific user group Provided in communication
Among the received data, one or more image data are extracted, and each character data received at a reception time close to each reception time of the one or more image data is assigned to each of the one or more image data. Generate summary data arranged in correspondence,
A summary data generation method characterized by executing processing. Regardless of the data reception corresponding to any user as long as the user belongs to a specific user group, the screen data displaying the received character data or image data in the order of reception time corresponds to the user belonging to the specific user group Provided in communication
Among the received data, one or more image data are extracted, and each character data received at a reception time close to each reception time of the one or more image data is assigned to each of the one or more image data. Generate summary data arranged in correspondence,
A summary data generation device comprising a control unit.

Images