JP6867989B2 - Communication provision system and communication provision method - Google Patents

Description

The present invention relates to a communication tool in a virtual space.

As a means of communication using an information terminal such as a personal computer or a smartphone, tools such as e-mail and SNS (social networking service) are generally used. For example, Patent Document 1 discloses a communication service system that enables viewing of the same content and sharing of objects on a plurality of client terminals via an SNS server.

Japanese Unexamined Patent Publication No. 2012-195000

However, conventional communication tools such as e-mail and SNS only exchange messages and images in virtual space, and are more inorganic (mechanical) than relative communication in the real world. It tends to be fun, surprised, and impressed.

The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a new communication tool in a virtual space. A further object of the present invention is to provide a means of communication in a virtual space that can create fun and emotion similar to communication in the real world.

A first aspect of the present invention is a communication providing system that provides a means of communication in a virtual space between a first person and a second person, and is a first aspect operated by the first person. As information sent from the terminal to the second person, an event including at least an event definition that defines an event to be given to the second person in the virtual space and an execution condition that is a condition for executing the event. When the receiving means for receiving the information and the second terminal operated by the second person satisfy the execution conditions included in the event information, the event definition included in the event information is used. It is a communication providing system characterized by having an event control means for causing the second terminal to execute the event based on the above.

With conventional communication tools such as e-mail and SNS, messages and the like are delivered to the recipient regardless of the state of the recipient, which may result in one-sided and mechanical communication. On the other hand, if the system of the present invention is used, the satisfaction of the "execution conditions" set by the first person (sender) causes the second person (receiver) to enjoy the "event". Therefore, the second person needs to take an action to clear the execution condition in the real world in order to enjoy the event in the virtual space. In other words, the second person needs a process to take some active action in order to receive the information sent from the first person. By providing such a process, it is possible to give a second person a feeling similar to communication in the real world, and it is possible to realize a new communication experience that has never existed before.

The execution condition includes a condition that defines a time and a place, and the event control means means that the second terminal exists at a place specified by the execution condition at a time specified by the execution condition. It is preferable to have the second terminal execute the event. By setting such an execution condition, the "time" and "place" in the real world become the conditions for enjoying the "event" in the virtual space. That is, the second person takes actions such as waiting until a predetermined time or moving to a predetermined place in order to receive the information sent from the first person. This makes it possible for a second person to have a feeling similar to real-world communication.

The second terminal has a predetermined application program, and the event control means transmits the event information to the predetermined application program of the second terminal, and the predetermined application. When the program receives the event information, it monitors the state of the second terminal, and when the second terminal is in a state of satisfying the execution condition included in the event information, the event information is added. The event may be executed based on the included event definition. According to this configuration, after notifying the event information to the second terminal, the communication between the second terminal and the communication providing system can be minimized or unnecessary. Therefore, the communication load and communication cost of the second terminal can be reduced. Alternatively, the event can be executed even if the second terminal goes offline.

The second terminal has a predetermined application program, and the event control means monitors the state of the second terminal based on the information notified from the predetermined application program, and the second terminal. When the terminal is in a state of satisfying the execution condition included in the event information, the predetermined application program may execute the event based on the event definition included in the event information. According to this configuration, since the main processing is executed on the communication providing system side (server side), the processing load on the second terminal side (client side) can be reduced and the predetermined application program (client program) is simplified. And it is also possible to reduce the size.

The event may include displaying an image or message on the second terminal and / or outputting sound from the second terminal. Further, the second terminal may have a camera, and the predetermined application program may have a function of superimposing and displaying the image or the message on an image in the real space captured from the camera. By using such augmented reality (AR), it is possible to give a second person a feeling more similar to communication in the real world.

The present invention can be regarded as a communication providing system, a communication providing server, an SNS server, an augmented reality system, a computer, an information processing device, and the like including a part or all of the above-described configurations. Further, the present invention can be regarded as a communication providing method including a part or all of the above-mentioned processes, a computer control method, an information processing method, and the like. Further, the present invention is regarded as a program for causing a computer (or a processor of a computer) to execute a part or all of the above-mentioned processes, or a computer-readable storage medium in which the program is temporarily stored. Can be done.

According to the present invention, it is possible to provide a new communication tool in a virtual space.

FIG. 1 is a diagram showing an overall configuration of a communication providing system according to an embodiment of the present invention. FIG. 2 is a diagram showing a functional configuration of a communication providing system. FIG. 3 is a diagram showing a functional configuration of an information terminal used by the user. FIG. 4 is a diagram showing a processing flow of generation / transmission of transmission information in the sender terminal. FIG. 5 is a diagram showing a processing flow of transmitting information reception in the communication providing system. FIG. 6 is a diagram showing a processing flow of event control in the communication providing system and the receiver terminal. FIG. 7 is a diagram showing a new event creation screen on the sender terminal. FIG. 8 is a diagram showing an event execution screen on the receiver terminal. FIG. 9 is a diagram showing an example of holding a fireworks display in a virtual space using a communication providing system.

An example of a preferred embodiment of the present invention will be described below with reference to the drawings.

<System configuration>
FIG. 1 shows the overall configuration of the communication providing system 1 (hereinafter, also simply referred to as “system”) according to the embodiment of the present invention. This system 1 provides a means of communication in a virtual space between a plurality of users U1, U2 ... This communication means is provided, for example, as one of the communication tools in SNS (Social Networking Service).

With reference to FIG. 1, a general flow when the user U1 (first person) transmits information to the user U2 (second person) will be described. The user U1 who is the sender operates his own information terminal (for example, a smartphone; the first terminal) T1 to generate transmission information to be sent to the other party. In this transmission information, "destination information" (for example, user U2's SNS account or email address) that identifies the recipient (destination of information), and an event to be given to the other party (user U2) in the virtual space are defined. "Event definition" to be executed, "execution condition" which is a condition for executing an event, etc. are included. Hereinafter, information related to an event, such as an event definition and an event execution condition, is collectively referred to as "event information".

The "event" may be any as long as it is executed on the information terminal (for example, a smartphone or the like; a second terminal) T2 of the user U2 who is the receiver and can be perceived by the user U2 by the five senses. For example, display of images (still images, moving images) and messages on the information terminal T2, output of sound (sound, voice, music) from the information terminal T2, light emission of the information terminal T2, vibration of the information terminal T2, and the like. Be done.

An "event definition" is one in which the type and contents of an event are described in a predetermined event description language. For example, in the case of an event in which a birthday song is played together with displaying an image, a URI (Uniform Resource) of image data and music data is used.
Identifier), the output order of images and songs, etc. are defined. In the case of an event in which a virtual firework is launched in a virtual space, the specifications of the fireworks, the launch order, the sound effect, etc. are defined.

The "execution condition" may be defined as a start condition in which the event is executed in relation to the state of the information terminal T2 of the user U2 who is the receiver in the real world. For example, conditions such as the time when the event may be executed and the place where the event may be executed are assumed. The time condition may be one time point such as 10:30, a time zone such as 10:00 to 11:00, or a date designation such as 0:00 to 24:00 on November 9, 2018. May include. The location condition may be specified by latitude / longitude, or by address, area, facility name, or the like. Further, one point (position) may be specified, or an area (range) may be specified.

The transmission information generated by the user U1 is sent to the system 1 and stored as shown in FIG. After that, the system 1 monitors the state of the information terminal T2 of the user U2, and when the information terminal T2 satisfies the execution condition, causes the information terminal T2 to execute an event based on the event definition. Alternatively, the information terminal T2 may monitor its own state and execute an event when the execution condition is satisfied.

By using such a mechanism, for example, when the user U2 visits a memorable place on his / her birthday, an old photo is displayed on the information terminal T2 and a birthday song can be set up for a surprise event. .. It is also possible to apply an application such as viewing a CG (virtual fireworks display) of fireworks launched at a predetermined place at a predetermined date and time with an augmented reality application on the information terminal T2. Alternatively, this mechanism can be applied to a game (treasure hunting game, puzzle solving game, character collecting game, etc.) that searches for an object that appears at a predetermined place at a predetermined time.

Conventional communication tools such as e-mail and SNS may result in one-sided and mechanical communication. On the other hand, if the system 1 is used, satisfying the "execution condition" set by the user U1 is a condition for the user U2 to enjoy the "event". Therefore, the user U2 is on the virtual space. In order to enjoy the event at, it is necessary to take actions such as going to a designated place at a predetermined date and time in the real world. By deliberately providing such a process (action in the real world), it is possible to give the user U2 a feeling, enjoyment, impression, etc. similar to communication in the real world, and realize a new communication experience that has never existed before. it can.

<Communication provision system>
FIG. 2 shows the functional configuration of the communication providing system 1 according to the present embodiment. The main functions of this system 1 are an event information reception unit (reception means) 20, an event control unit (event control means) 21, a user database (user information storage means) 22, and an event task database (event task storage means) 23. Have. In the following, for convenience of explanation, the person who sends the event information is the "sender", the information terminal operated by the sender is the "sender terminal", the person who receives the event information is the "receiver", and the receiver operates it. The information terminal to be used is called a "recipient terminal".

The event information reception unit 20 has a function of receiving transmission information addressed to the receiver from the sender terminal. As described above, the transmission information includes at least the destination information that identifies the recipient, the event definition, and the execution condition. The event control unit 21 has a function of causing the receiver terminal to execute an event based on the event definition when the receiver terminal is in a state of satisfying the execution condition. The user database 22 is a database that stores and manages information on registered users of the SNS provided by the system 1. Registered user information includes, for example, user's personal information and attribute information, user's SNS account and password, user's email address, SNS settings (for example, information disclosure / non-disclosure settings, affiliated community, screen design, etc. Display items) etc. should be included. The event task database 23 is a database that manages event tasks corresponding to event information received by the event information receiving unit 20. The event control unit 21 executes event control according to the event task registered in the event task database 23. Details of the operation of each function will be described later.

The system 1 can be configured by, for example, a general-purpose server computer including a CPU (processor), a memory, an auxiliary storage device (hard disk, SSD, etc.), a display device, an input device, an output device, a communication module, and the like. In the case of such a configuration, each function shown in FIG. 2 is realized by software by expanding the program stored in the auxiliary storage device into the memory and executing it by the CPU. The configuration of the system 1 may be in any form. For example, it may be configured by one computer or may be configured by a plurality of computers. In addition, cloud computing and distributed computing may be used. Alternatively, a part or all of the functions shown in FIG. 2 may be configured by a dedicated IC chip or hardware.

<User information terminal>
FIG. 3 shows the functional configuration of the information terminal used by the user. The information terminal has a transmission information generation unit 30, an event execution client 31, an imaging unit 32, a display unit 33, a voice output unit 34, and an operation unit 35 as main functions.

The transmission information generation unit 30 is a function used when the user becomes the sender, and is a function of generating transmission information to be sent by the user to the receiver. The event execution client 31 is a function used when the user becomes a receiver (event beneficiary), and is responsible for monitoring the status of the information terminal and executing the event in cooperation with the event control unit 21 of the system 1. It is a function. The image pickup unit 32 is a function of capturing an image (still image, moving image) from a camera included in the information terminal. The display unit 33 is a function of displaying a GUI, an image, a message, and the like on a display device included in the information terminal. The voice output unit 34 is a function of outputting voice to an output device included in the information terminal. The operation unit 35 is a function of receiving a user operation using an input device included in the information terminal. Details of the operation of each function will be described later.

The information terminal can be configured by, for example, a general-purpose computer including a CPU (processor), a memory, an auxiliary storage device (hard disk, SSD, etc.), a display device, an input device, an output device, a communication module, and the like. In the case of such a configuration, each function shown in FIG. 3 is realized by software by expanding the application program stored in the auxiliary storage device into the memory and executing it by the CPU. The configuration of the information terminal may be in any form. For example, cloud computing or distributed computing may be used. Alternatively, a part or all of the functions shown in FIG. 3 may be configured by a dedicated IC chip or hardware. In the present embodiment, it is assumed that a smartphone or tablet terminal is used as the information terminal, but any type of device may be used as the information terminal as long as it is a computer having a communication function, a display function, and a camera. For example, a personal computer, a mobile phone (feature phone), a wearable terminal, a smart watch, a game device, or the like may be used.

<Operation example>
An example of the operation of the communication providing system 1 and the information terminal will be described with reference to FIGS. 4 to 8. FIG. 4 is an example of a processing flow for generating / transmitting transmission information in the sender terminal, FIG. 5 is an example of a processing flow for receiving transmission information in the system 1, and FIG. 6 is an example of the system 1 and the receiver terminal. This is an example of the event control processing flow in. Further, FIG. 7 is an example of a new event creation screen on the sender terminal, and FIG. 8 is an example of an event execution screen on the receiver terminal. It is assumed that a predetermined application program (hereinafter, simply referred to as "application") for using the SNS provided by the system 1 is installed in the sender terminal and the receiver terminal.

First, when the sender starts the application on the sender terminal and selects the "new event" menu (step S40 in FIG. 4), the display unit 33 displays the new event creation screen shown in FIG. 7 (step S41). .. The new event creation screen includes a GUI for inputting information such as destination information, event definition, and execution conditions (time and place), and the sender can input such information using the operation unit 35. FIG. 7 shows an example in which “Ms.A” sends two types of events, “image display” and “audio reproduction”, to “Mr.B”. Specifically, when the recipient "Mr. B" visits "Restaurant X" from "12:00 to 13:00 on November 9, 2018", the image "123.jpg" is displayed and the music " This is a definition example of an event of playing "HappyBirthday.mp3". Although an example of designating image data and music data existing in the sender terminal is shown here, it is of course possible to display and play back the contents on the network.

After inputting all the information, when the sender selects the "event transmission" button, the transmission information generation unit 30 generates transmission information based on the information input on the new event creation screen, and transmits the transmission information in the system 1. (Step S42). This completes the event transmission process by the sender.

The transmission information transmitted from the sender terminal is received by the event information reception unit 20 of the system 1 (step S50 in FIG. 5). The event information reception unit 20 generates a new event task based on the received transmission information, and registers the event task in the event task database 23 (step S51). The event task includes at least the sender and receiver (recipient) of the event, the event definition, and the execution conditions (execution location and executable time) of the event. In the above example, when the recipient "Mr. B" visits "Restaurant X" from "12:00 to 13:00 on November 9, 2018", the image "123.jpg" is displayed and the image is displayed. An event task that defines an event to play the song "HappyBirthday.mp3" is generated. It is preferable that the event tasks are sorted in the event task database 23 in ascending order of the event execution time.

Next, the event control processing in the system 1 and the receiver terminal will be described with reference to FIG. The event control unit 21 of the system 1 periodically checks the event task database 23 and extracts the event task whose event execution time is approaching (step S60). For example, in the present embodiment, the event task is designed to be extracted 5 minutes before the executable time. The event control unit 21 starts monitoring the status of the recipient terminal for the extracted event task (step S61).

The processes of steps S62 to S66 are executed for each of all event tasks for which status monitoring is being performed. In step S62, the event control unit 21 acquires the state of the receiver terminal from the receiver terminal. The state of the receiver terminal may include at least position information indicating where the receiver terminal exists in the real world (for example, latitude / longitude information measured by a GPS sensor). The state may be acquired actively by the event control unit 21 sending a request to the receiver terminal, or the event control unit 21 passively acquires the information periodically notified from the receiver terminal side. You may receive it at.

Upon receiving the status (location information) of the recipient terminal, the event control unit 21 compares the location information of the receiver terminal with the condition of the execution location of the event included in the event task, and the current position of the receiver terminal is the event. It is determined whether or not the condition of the execution location of is satisfied (step S63). The event control unit 21 also determines whether or not the current time satisfies the condition of the event execution time (step S64). Only when any of the conditions is cleared, the event control unit 21 causes the recipient terminal to execute the event according to the event definition included in the event task (step S65). In the case of this example, the event control unit 21 transmits the page data in which the image data and the music data are embedded to the receiver terminal, and passes the page data to the application of the receiver terminal to obtain the image data. Display and play music data on the recipient terminal. FIG. 8 shows how the event is executed at the receiver terminal.

According to the above control, when the receiver visits a predetermined place at the time set by the sender while carrying the receiver terminal, the image display and the music playback are automatically performed on the receiver terminal at that timing. It will be started. As a result, the recipient can feel the feeling, enjoyment, impression, etc. similar to the communication in the real world. Information on the event execution time and execution location may be communicated to the sender in advance, or may be kept secret from the sender. The former communication method can be any method, for example, when the system 1 registers an event task, the recipient terminal is notified of the location and time of the event, or the sender can use other communication tools such as e-mail or telephone. There is a way to contact the recipient directly. Keeping it secret like the latter is suitable, for example, when you want to produce a surprise event or when you want to produce a treasure-hunting game.

If the event execution time has passed while the status (position) of the recipient terminal does not satisfy the condition of the event execution location, the event task is deleted without being executed (step S66). .. When the event task is deleted, the sender should be notified that the event could not be given to the recipient.

<Application example>
Various application examples can be considered for the communication providing system 1 of the present embodiment.

FIG. 9 shows an example of holding a fireworks display in a virtual space using the system 1. A user operates a fireworks production application on an information terminal to produce a virtual fireworks (S90). Various types of gunpowder balls are prepared as virtual items on the fireworks production application, and users can combine their favorite gunpowder balls to create fireworks with a free design. You can also try out the fireworks you made on the fireworks making app (S91). When you are satisfied with the fireworks, you can save your work (S92).

Subsequently, the user operates the fireworks display holding application on the information terminal to set the fireworks display in the virtual space (S93). Specifically, the launch location and time, the fireworks display notification method and invitation method, the fireworks to be used, the launch method, and related information such as BGM are set on the application. After completing all the settings, the user sends the fireworks display setting data to the fireworks display server from the fireworks display holding application. Although fireworks are not actually launched, augmented reality (AR) is used to synthesize fireworks by CG in the real world, so the location information (latitude, latitude, etc.) in the real world is used for the launch location. Set the longitude or address).

The fireworks display server is a server that executes the fireworks display in the virtual space, and is constructed by using the communication providing system 1 described above. That is, "launching fireworks in a virtual space" corresponds to an event, "a person who produces fireworks and puts them up for a fireworks display" or "a person who sets a fireworks display" corresponds to an event sender, and "fireworks". The person who watches the event corresponds to the recipient of the event.

When the fireworks display server receives the fireworks display setting data, it saves and publishes this data (S94). In addition, the fireworks display server notifies the viewers of the fireworks display of the information on the fireworks display (S95). At this time, the information on the fireworks display can be notified only to the designated invitees, or the information can be notified to unspecified persons such as all the registered users of the system 1. In addition, the person who receives the notification can also transfer the notification to another person (S96).
..

At the scheduled time of the fireworks display, the fireworks display server starts launching fireworks in the virtual space (S97). Specifically, in the real world, the fireworks display server sends CG animation and sound effect data of the fireworks display to the information terminal that exists within a predetermined range (that is, the area where the fireworks display can be viewed) from the launch location of the fireworks display. Is transmitted, and they are output to the information terminal (S98). Viewers can view the CG animation of the fireworks using the Augmented Reality (AR) app. That is, the image of the real world captured from the camera is displayed on the screen of the augmented reality application, and when the viewer points the terminal toward the launch location of the fireworks, the CG animation of the fireworks is superimposed on the image of the real world. You can see the image as if fireworks were launched in the real world. In this embodiment, the form in which the data of the CG animation and the sound effect of the fireworks display is created on the fireworks display server side is illustrated, but the information about the fireworks display (for example, the specifications of the fireworks, (Physical information, CAD data, etc.) may be sent, and the information terminal may generate a CG animation of the fireworks display based on the information.

After the fireworks display is over, the viewer can evaluate the fireworks display (S99). This evaluation is aggregated by the fireworks display server (S100), and the aggregation result is fed back to the organizer of the fireworks display (S101).

1: Communication providing system, 20: Event information reception unit, 21: Event control unit, 22: User database, 23: Event task database, 30: Transmission information generation unit, 31: Event execution client, 32: Imaging unit, 33: Display unit, 34: Audio output unit, 35: Operation unit, T1, T2: Information terminal, U1, U2: User

Claims (6)

A communication providing system that provides a means of communication in a virtual space between a first person and a second person.
As information sent from the first terminal operated by the first person to the second person, an event definition that defines an event to be given to the second person in the virtual space and the event are executed. A reception means that accepts event information including at least an execution condition, which is a condition for
A terminal operated by the second person , which is included in the event information when the camera and the second terminal having a predetermined application program satisfy the execution conditions included in the event information. An event control means for causing the second terminal to execute the event based on the event definition.
Have a,
When the second terminal satisfies the execution condition included in the event information, the predetermined application program determines the position in the real space and the position in the real space based on the event definition included in the event information. It has a function of superimposing and displaying an image corresponding to time on an image in real space captured from the camera.
A communication providing system characterized by this. The execution conditions include conditions that specify the time and place.
The event control means causes the second terminal to execute the event when the second terminal exists at the place specified by the execution condition at the time specified by the execution condition. The communication providing system according to claim 1, which is characterized. Before Symbol event control means is adapted to transmit the event information to the predetermined application program of the second terminal,
When the predetermined application program receives the event information, it monitors the state of the second terminal, and when the second terminal is in a state of satisfying the execution condition included in the event information, the predetermined application program monitors the state of the second terminal. The communication providing system according to claim 1 or 2, wherein the event is executed based on the event definition included in the event information. Before Symbol event control means, a state in which the state of the second terminal monitors based on information notified from the predetermined application program, satisfies the execution condition where the second terminal is included in the event information The communication providing system according to claim 1 or 2, wherein the predetermined application program executes the event based on the event definition included in the event information. The communication providing system according to claim 3 or 4, wherein the event includes displaying an image or a message on the second terminal and / or outputting a sound from the second terminal. .. It is a communication providing method that provides a means of communication in a virtual space between a first person and a second person.
As information sent from the first terminal operated by the first person to the second person, an event definition that defines an event to be given to the second person in the virtual space and the event are executed. A step that accepts event information including at least an execution condition that is a condition
The event information includes the terminal operated by the second person when the camera and the second terminal having a predetermined application program satisfy the execution conditions included in the event information. A step of causing the second terminal to execute the event based on the event definition.
Have a,
When the second terminal satisfies the execution condition included in the event information, the predetermined application program determines the position in the real space and the position in the real space based on the event definition included in the event information. It has a function of superimposing and displaying an image corresponding to time on an image in real space captured from the camera.
A method of providing communication that is characterized by this.

Images