JP2022139693A - Information processing server and virtual space provision system - Google Patents

Abstract

To provide an information processing server and a virtual space provision system that make it easier to feel a connection with the reality in activities in a virtual space.SOLUTION: An information processing server 30 moves a first avatar according to the movement of a salesperson user P1 in a first space RS1, in a virtual space having the arrangement of structures imitating the first space RS1, and moves a second avatar according to an instruction from a customer user P2 in a second space RS2. Furthermore, the information processing server 30 performs processing for establishing a conversation between the salesperson user P1 and the customer user P2 with the first avatar and the second avatar intervening and transmits, to a customer terminal 21, display data for displaying both an image of the virtual space and the situation of the first space RS1.SELECTED DRAWING: Figure 1

Description

The present invention relates to an information processing server and a virtual space providing system used for communication using virtual reality.

In recent years, the development of systems for communication using virtual reality is progressing. Applications of such systems are not limited to games, and are expanding to new applications such as service provision. An example of service provision is the sale of goods. For example, Patent Literatures 1 and 2 describe systems in which a salesperson and a customer can communicate with each other using avatars in a virtual space.

JP 2009-205661 A JP-A-2012-8638

The above-mentioned new uses of the system that provides the virtual space are intended to replace the activities originally performed in the real space, unlike the uses such as games, which are premised on proceeding in the virtual space. If an activity in the real space can be substituted with an activity in the virtual space, it will be highly convenient for users who have difficulty going to the place of activity in the real space due to restrictions on means of transportation, time, restrictions on going out, etc. . On the other hand, since it is difficult to feel a connection with reality in activities in virtual space, there are still many points that are insufficient as a substitute for activities in real space. For example, the sensations obtained through visual and auditory sensations in activities in the real space, such as the sensations obtained in face-to-face conversations and observation of real objects such as products, are lost in activities in virtual spaces. It's getting harder to feel the connection between

An information processing server for solving the above problems is a position specifying device that is first information output from a device located in a first space and that is information capable of specifying the position of a first user in the first space. and output from a display terminal operated by a second user in a second space and a first receiving unit for receiving the first information including at least first conversation information indicating an utterance of the first user; a second receiving unit for receiving the second information, which is the second information and includes at least instruction information indicating an instruction of the second user and second conversation information indicating an utterance of the second user; A first avatar, which is a first object, is moved in a virtual space having an arrangement of structures simulating one space in accordance with the movement of the first user in the first space based on the position specifying information. a virtual space generator for moving a second avatar, which is a second object, according to an instruction from the second user based on the instruction information; a conversation processing unit that performs processing to establish a conversation between the first user and the second user interposed by one avatar and the second avatar; an image of the virtual space; and the first space based on the first information. and a display data generation unit for generating display data for displaying a display indicating the status of the display, and a transmission unit for transmitting the display data to the display terminal.

A virtual space providing system that solves the above problems includes a first acquisition unit that acquires first information in a first space, and position specifying information that is information that can specify a position of a first user in the first space. and first conversation information indicating an utterance of the first user, the first acquiring unit acquiring the first information, and the second acquiring unit acquiring the second information in a second space, The second acquisition of acquiring the second information including at least instruction information indicating an instruction based on an operation of the second user on the display terminal in the second space and second conversation information indicating a statement of the second user. and a first object, which is a first object, according to the movement of the first user within the first space based on the position specifying information, in a virtual space having an arrangement of structures imitating the first space. a virtual space generation unit that moves one avatar and moves a second avatar that is a second object in accordance with an instruction from the second user based on the instruction information; and the first conversation information and the second conversation information. using a conversation processing unit that performs processing to establish a conversation between the first user and the second user intervening the first avatar and the second avatar, an image of the virtual space, and the first information and a display data generating unit that generates display data for displaying on the display terminal a display indicating the situation of the first space based on the above.

According to the above configuration, the display terminal displays the image of the virtual space and the display showing the situation of the first space. Therefore, compared to the case where only the image of the virtual space is displayed, it becomes easier for the second user to feel a connection with reality in the activity in the virtual space.

In the above configuration, the first space is a space in which a service using exhibits is provided, the first user is a person in charge of customer service in the service, and the second user communicates through the virtual space. It may be a person who receives the provision of the service.

The provision and enjoyment of services using exhibits has traditionally been carried out in real space. It is also important to increase the satisfaction of service recipients. By using the virtual space providing system to provide a service using exhibits, the second user can easily feel a connection with reality by obtaining a feeling close to activities in the real space. The degree of satisfaction of the second user who is the recipient of this can be favorably enhanced.

In the above configuration, the first conversation information may be video data, and the display showing the situation of the first space may include an image of the first user based on the first conversation information.
According to the above configuration, the second user can obtain a feeling close to face-to-face conversation in the conversation with the first user through the avatar. Therefore, in activities in the virtual space, it becomes easier to feel a connection with reality.

In the above configuration, the display showing the situation of the first space may include a display showing the working situation of the first user in the first space.
According to the above configuration, since the second user can grasp the situation of the first user in the first space, it is possible to adjust the timing of conversation, etc., and to efficiently proceed with activities in the virtual space. Also, the second user can easily perceive that the first avatar is an alter ego of a person who is actually active in the first space. Therefore, in activities in the virtual space, it becomes easier to feel a connection with reality.

In the above configuration, the first information includes determination information that is information that can determine the customer service status of the first user in the first space, and the display indicating the status of the first space is the first user's service status. is being served in the first space, and includes the display being served in association with the first avatar, wherein the display data generation unit includes: The display data may be generated for displaying an image including the display indicating that the first user is serving customers.

According to the above configuration, the second user can easily grasp whether or not the first user can respond to the request for conversation, so that it is possible to adjust the timing of conversation, etc. can proceed efficiently. Also, the second user can easily sense that the first avatar is not a character who serves customers only in the virtual space, but an alter ego of a person who actually serves customers in the store in the real space. Therefore, in activities in the virtual space, it becomes easier to feel a connection with reality.

In the above configuration, the first information includes shooting information composed of shooting data in the first space, and the display indicating the situation of the first space includes an image in the first space based on the shooting information. It's okay.

According to the above configuration, the second user can confirm the appearance of the article in the first space. Therefore, it is possible to obtain a feeling close to that of actually visiting the first space. Therefore, in activities in the virtual space, it becomes easier to feel a connection with reality.

In the above configuration, the device located in the first space is a photographing device that generates the photographing information, and includes the photographing device configured to be movable in the first space, and the second information includes: Operation information that is information indicating an instruction to move the imaging device may be included, and the transmission unit may transmit an instruction to move the imaging device according to the operation information to the imaging device.

According to the above configuration, since the second user can remotely control the photographing device, the second user's will is more strongly reflected in the image of the first space displayed on the display terminal. Therefore, it becomes easier for the second user to check the appearance of the article in the first space according to the intention of the second user, and the second user can get a feeling closer to that of actually visiting the first space.

In the above configuration, the display data may be data for displaying the image of the virtual space and the display indicating the situation of the first space on one screen.
According to the above configuration, the second user can obtain both the feeling of being active in the virtual space and the feeling close to the experience in the real space. Therefore, by combining these senses, it is possible to obtain a feeling that is closer to the experience in the real space as a feeling obtained by activities in the virtual space. Therefore, in activities in the virtual space, it becomes easier to feel a connection with reality.

In the above configuration, each of the first conversation information and the second conversation information includes audio data, and the conversation processing unit increases the distance between the first avatar and the second avatar so that the first conversation information setting the volume of the voice to be output based on the conversation information to be low, and the transmission unit instructing the display terminal to output the voice based on the first conversation information at a volume according to the setting of the conversation processing unit; You may send.

According to the above configuration, the distance between avatars affects the volume of conversation in the same way that the distance between people affects the volume of conversation in the real space. Therefore, the second user can get a feeling closer to the experience in the real space in the activity in the virtual space.

In the above configuration, the conversation processing unit determines whether or not to have a conversation according to the distance between the first avatar and the second avatar, and establishes the conversation when the distance is equal to or less than a predetermined value. may be performed.

According to the above configuration, the distance between avatars affects whether or not a conversation can be held in the same way that the distance between people affects whether or not a conversation can be held in the real space. Therefore, the second user can get a feeling closer to the experience in the real space in the activity in the virtual space.

ADVANTAGE OF THE INVENTION According to this invention, it can be made easy to feel connection with reality in the activity in virtual space.

1 is a block diagram showing the overall configuration of a virtual space providing system according to one embodiment; FIG. The figure which shows an example of the virtual space which the virtual space provision system of one Embodiment produces|generates. FIG. 4 is a sequence diagram showing the flow of processing in the basic functions of the virtual space providing system of one embodiment; The figure which shows an example of the screen of the display terminal in the virtual space provision system of one Embodiment. FIG. 4 is a sequence diagram showing the flow of processing in the conversation function of the virtual space providing system of one embodiment; The figure which shows an example of the screen of the display terminal in the virtual space provision system of one Embodiment. The figure which shows an example of the screen of the display terminal in the virtual space provision system of one Embodiment. 4 is a flow chart showing the flow of conversation permission/prohibition determination processing in the virtual space providing system of one embodiment. 4 is a sequence diagram showing the flow of processing in conversation volume adjustment processing of the virtual space providing system of one embodiment; FIG. 4 is a flow chart showing the flow of processing in the customer service status display function of the virtual space providing system of one embodiment. The figure which shows an example of the screen of the display terminal in the virtual space provision system of one Embodiment. FIG. 4 is a sequence diagram showing the flow of processing in the indoor photography function of the virtual space providing system of one embodiment; The figure which shows an example of the screen of the display terminal in the virtual space provision system of one Embodiment. FIG. 4 is a sequence diagram showing the flow of processing in the trial function of the virtual space providing system of one embodiment; The figure which shows an example of the screen of the display terminal in the virtual space provision system of one Embodiment.

An embodiment of an information processing server and a virtual space providing system will be described with reference to FIGS. 1 to 15. FIG.
[Overall Configuration of Virtual Space Providing System]
The overall configuration of the virtual space providing system 100 will be described with reference to FIG. In this embodiment, as an example, a case where the virtual space providing system 100 is used for selling products will be described.

The first space RS1 and the second space RS2 are real spaces separated from each other. The first space RS1 is a space in the store where products displayed in the store are sold, and a salesperson user P1 who is a first user is located in the first space RS1. The salesperson user P1 is a product salesperson who sells products to customers who have actually visited the first space RS1.

A customer user P2 who is a second user is located in the second space RS2. Customer user P2 is a person who plans to purchase a product through the virtual space provided by virtual space providing system 100 . The second space RS2 is an arbitrary space, and may be, for example, a space in the home of the customer user P2.

In the virtual space providing system 100, an avatar corresponding to the salesperson user P1 and an avatar corresponding to the customer user P2 are arranged in a virtual shop, which is a virtual space modeled after the first space RS1. Using these avatars, salesperson user P1 and customer user P2 communicate with each other about buying and selling products.

As shown in FIG. 1, the virtual space providing system 100 includes an information processing server 30, a first device 10 positioned in a first space RS1, and a second device 20 positioned in a second space RS2. The first device 10 includes a location information collection device 11 , a salesperson terminal 12 and a photographing device 13 . The second device 20 includes a customer terminal 21 .

The first device 10 and the second device 20 and the information processing server 30 mutually transmit and receive data through the network NW. The network NW used for communication between each device included in the first device 10 and the second device 20 and the information processing server 30 may be a general-purpose communication line such as the Internet, or a dedicated communication line for communication between each device. It may be a communication line. Also, the network NW may include a plurality of independent networks, or may be one common network.

The position information collection device 11 acquires position specifying information Ip, which is information capable of specifying the position of the salesperson user P1 in the first space RS1. The position information collecting device 11 transmits the position specifying information Ip to the information processing server 30 .

The position specified based on the position specifying information Ip may be a position relative to the reference position in the first space RS1, or may be an absolute position using latitude and longitude. The location information collection device 11 includes equipment capable of detecting the location of the salesperson user P1 in a desired manner. Depending on the position detection method, each device constituting the position information collection device 11 may be arranged at a predetermined position in the first space RS1, or may be carried by the salesperson user P1.

For example, the positional information collection device 11 may include a camera, and the position of the salesperson user P1 may be identified by analyzing images captured by the camera. The identification of the salesperson user P1 may be performed by identification of the face of the salesperson user P1, identification of a marker worn by the salesperson user P1 in advance, or the like.

Further, for example, the location information collection device 11 includes a transmitter and a receiver compatible with short-range wireless communication such as Bluetooth (registered trademark), and the receiver receives radio waves from the transmitter carried by salesperson user P1. The position of the salesperson user P1 may be identified from the received status.

Note that the position specifying information Ip may be information that can specify the orientation of the salesperson user P1 in addition to the position thereof. In this case, the positional information collection device 11 may include a motion sensor, or a device that constitutes a head tracking or face tracking system.

The location of the salesperson user P1 based on the information collected by the location information collection device 11 may be specified by the location information collection device 11 or by the information processing server 30 . That is, the position specifying information Ip may be information indicating the result of specifying the position of the salesperson user P1, or information that enables the position of the salesperson user P1 to be specified by calculation using the position specifying information Ip. may

The salesperson terminal 12 is a device used by the salesperson user P1 for conversation with the customer user P2. The conversation between the salesperson user P1 and the customer user P2 is conducted by text, voice, or animation. The salesperson terminal 12 only needs to include equipment corresponding to the means of conversation. That is, the salesperson terminal 12 may be any device capable of at least one of inputting and displaying characters, inputting and outputting voice, and capturing and displaying moving images. For example, the salesperson terminal 12 is a headset, a smart phone, a tablet terminal, a wearable terminal, a device for video calling, or the like.

The salesperson terminal 12 receives first conversation information Ic1, which is information indicating the speech of the salesperson user P1. Salesperson terminal 12 transmits first conversation information Ic1 to information processing server 30 . The first conversation information Ic1 is composed of text, voice, or moving image data according to the means of conversation.

The photographing device 13 photographs an image within the first space RS1. It is preferable that the photographing device 13 is capable of photographing moving images. The imaging device 13 includes, for example, a camera fixed at a predetermined position within the first space RS1. For example, the camera is arranged at a position where the product can be photographed. Alternatively, the photographing device 13 may be movable in the first space RS1 and the movement of the photographing device 13 may be remotely controlled. An example of the imaging device 13 capable of remote control is a telepresence robot.

The photographing device 13 generates photographing information Iv including photographing data in the first space RS1 and transmits the photographing information Iv to the information processing server 30 . Further, when the photographing device 13 can be remotely controlled, the photographing device 13 receives instructions from the information processing server 30 and changes the photographing position and photographing direction.

The information output by the first device 10, in other words, the information output by each of the position information collecting device 11, the salesperson terminal 12, and the photographing device 13 is the first information If1 that indicates the situation of the first space RS1. be. That is, the first information If1 includes position specifying information Ip, first conversation information Ic1, and photographing information Iv. In the virtual space providing system 100, the first device 10 functions as a first acquisition unit that acquires the first information If1 in the first space RS1.
Note that one device may serve as two or more of the location information collection device 11 , salesperson terminal 12 , and photographing device 13 .

The customer terminal 21 is a display terminal having a display section for displaying images. The customer terminal 21 is operated by customer user P2. The customer terminal 21 is, for example, a smart phone, a tablet terminal, a personal computer, or the like. The customer terminal 21 displays an image based on the display data received from the information processing server 30 . The display contents of the customer terminal 21 include an image of the virtual space and a first situation display which is a display showing the situation of the first space RS1.

Further, the customer terminal 21 receives instruction information Is, which is information indicating an instruction of the customer user P2 to the virtual space. The instruction information Is includes information for instructing movement of the avatar corresponding to the customer user P2. The instruction information Is is transmitted from the customer terminal 21 to the information processing server 30 .

Further, the customer terminal 21 receives second conversation information Ic2, which is information indicating an utterance of customer user P2. The second conversation information Ic2 is composed of text, voice, or moving image data according to the means of conversation between the salesperson user P1 and the customer user P2. The customer terminal 21 has the functions of inputting and displaying characters, inputting and outputting voice, and capturing and displaying moving images in accordance with means of conversation. The second conversation information Ic2 is transmitted from the customer terminal 21 to the information processing server 30 .

Further, in response to the operation of the customer terminal 21 by the customer user P2, the customer terminal 21 sends to the information processing server 30 a request for an image of the first space RS1 and a request for trial use of the product. When the photographing device 13 can be remotely operated, the customer terminal 21 receives operation information Io, which is information indicating an instruction to move the photographing device 13, when requesting an image of the first space RS1. is transmitted from the customer terminal 21 to the information processing server 30 .

The functions of the customer terminal 21 in the virtual space providing system 100 are materialized by application software installed in the customer terminal 21, for example. A specific example of such application software is a virtual store shopping app.

The information output by the second device 20, in other words, the information output by the customer terminal 21 is the second information If2. That is, the second information If2 includes instruction information Is, second conversation information Ic2, and operation information Io. In the virtual space providing system 100, the second device 20 functions as a second acquisition unit that acquires the second information If2 in the second space RS2.

The information processing server 30 includes a communication section 31 , a control section 32 and a storage section 33 .
The communication unit 31 executes connection processing between the information processing server 30 and each device included in the first device 10 and the second device 20 via the network NW, and transmits and receives data between the connected devices. The communication unit 31 functions as a first reception unit that receives the first information If1 from the first device 10 and a second reception unit that receives the second information If2 from the second device 20 . The communication unit 31 also functions as a transmission unit that transmits display data to the customer terminal 21 and a movement instruction to the imaging device 13 .

The control unit 32 has a configuration including a CPU and a volatile memory such as a RAM. Based on the programs and data stored in the storage unit 33, the control unit 32 controls processing by the communication unit 31, reads and writes information in the storage unit 33, performs various arithmetic processing, etc., and controls each unit provided in the information processing server 30. control. In the virtual space providing system 100, the control unit 32 functions as a virtual space generation unit 32a, a conversation processing unit 32b, a reception situation determination unit 32c, a photographing instruction unit 32d, a trial execution unit 32e, and a display data generation unit 32f.

The virtual space generation unit 32a sets the positions of objects including the first avatar A1 and the second avatar A2 in one virtual space having a layout of structures imitating the first space RS1. The first avatar A1 is an avatar corresponding to the salesperson user P1, and the second avatar A2 is an avatar corresponding to the customer user P2. As a result, a virtual space VS is generated that includes the first avatar A1 and the second avatar A2 as components. FIG. 2 shows an example of the virtual space VS. The components of the virtual space VS also include an object representing the product Gd.

The virtual space generator 32a changes the position of the first avatar A1 based on the position specifying information Ip included in the first information If1. The virtual space generator 32a also changes the position of the second avatar A2 based on the instruction information Is included in the second information If2. That is, the virtual space generator 32a moves the first avatar A1 based on the position specifying information Ip, and moves the second avatar A2 based on the instruction information Is.

The conversation processing unit 32b uses the first conversation information Ic1 included in the first information If1 and the second conversation information Ic2 included in the second information If2 to establish a conversation between the salesperson user P1 and the customer user P2. Conversation execution processing is performed.

Further, the conversation processing unit 32b performs a conversation propriety determination process of determining propriety of conversation according to the distance between the first avatar A1 and the second avatar A2. Further, when the means of conversation is audio or video, the conversation processing unit 32b performs conversation volume adjustment processing for adjusting the volume of conversation according to the distance between the first avatar A1 and the second avatar A2.

The customer service status determination unit 32c uses the first information If1 to determine whether or not the salesperson user P1 is serving a customer who is actually visiting the first space RS1 in the first space RS1. When it is determined that the salesperson user P1 is serving a customer, the customer service status determining unit 32c causes the display content of the display data to be displayed on the customer terminal 21 to include an indication that the first avatar A1 is serving a customer. .

The photographing instruction unit 32d outputs an instruction to the photographing device 13 in response to a request from the customer terminal 21. FIG. The instruction to the imaging device 13 includes an instruction to transmit the imaging information Iv generated by the imaging device 13 . Further, when the photographing device 13 can be remotely operated, the instruction to the photographing device 13 includes an instruction to move the photographing device 13 based on the operation information Io included in the second information If2.

In response to a request from the customer terminal 21, the trial execution unit 32e performs a process of allowing the second avatar A2 to trial the product. The trial use of products includes, for example, trying on products such as clothes and accessories, and test-riding products such as vehicles.

The display data generator 32f generates display data that defines the display content on the customer terminal 21. FIG. The display data is data for causing the customer terminal 21 to display the image of the virtual space VS and the first situation display, which is a display showing the situation of the first space RS1. The first status display is a display showing the status of the first space RS1 at that point in time, and includes images in the first space RS1, such as images of the salesperson user P1 and products, and work such as customer service status of the salesperson user P1. Including a status indication.

The storage unit 33 has a configuration including a nonvolatile memory, and stores programs and data necessary for processing executed by the control unit 32 . Specifically, the storage unit 33 stores virtual space data 33a, which is data used to generate the virtual space VS.

The virtual space data 33a includes basic space data having a layout of structures modeled on the first space RS1 and data of objects that move within the virtual space VS.
The basic space is a virtual space that includes exhibits such as products, display stands and shelves for the exhibits, pillars, walls, and other fixed objects. The basic space only needs to imitate the first space RS1 so as to be able to reproduce the movement path of the person in the first space RS1, and the layout of the structures in the first space RS1 and the basic space does not completely match. you can For example, the basic space only needs to have a floor plan that matches the first space RS1, that is, a passage layout that matches the first space RS1, and the layout of exhibits in the basic space is completely the same as that of the first space RS1. It doesn't have to be.

The basic space data includes, for example, information on a three-dimensional orthogonal coordinate system set for the basic space, positional information of the above-mentioned fixed object, data that associates the position of the basic space with the position of the first space RS1, Contains data for rendering the underlying space. The object data also includes data for drawing the first avatar A1 and the second avatar A2.

It should be noted that the function of each part in the control part 32 may be embodied separately by a plurality of CPUs, various types of hardware such as memories made up of RAM and the like, and software that makes them function, or a common one. It may be embodied by software that provides multiple functions in one piece of hardware. Such software is stored in the storage unit 33 as a virtual space providing program.

[Operation of virtual space providing system]
The operation of the virtual space providing system 100 will be described with reference to FIGS. 3 to 15. FIG. The functions of the virtual space providing system 100 include a basic function, a conversation function, a reception status display function, an indoor photographing function, and a trial function. The operation of the virtual space providing system 100 in each function will be described below in order.

<Basic functions>
The basic functions are the placement and movement of the avatars A1 and A2 in the virtual space VS, and the function of displaying the virtual space VS on the customer terminal 21. FIG.

As shown in FIG. 3, the position information collection device 11 acquires the position specifying information Ip and transmits it to the information processing server 30 (step S10). When the position specifying information Ip is received, the virtual space generation unit 32a of the information processing server 30 uses the virtual space data 33a to create a virtual space VS corresponding to the position in the first space RS1 specified based on the position specifying information Ip. The position of the first avatar A1 is set in the position (step S11).

As a result, the position of the first avatar A1 is adjusted so that the positional relationship of the salesperson user P1 with respect to the structure in the first space RS1 corresponds to the positional relationship of the first avatar A1 with respect to the structure in the virtual space VS. set. By repeating the processes of steps S10 and S11 at predetermined intervals, the position of the first avatar A1 within the virtual space VS changes according to the movement of the salesperson user P1 within the first space RS1.

On the other hand, when customer user P2 performs a predetermined operation on customer terminal 21 to request display of the virtual shop, a request for display of virtual space VS is transmitted from customer terminal 21 to information processing server 30 (step S12). ). The predetermined operation is, for example, an operation of selecting a predetermined area of a screen displayed by activating a virtual store shopping application on the customer terminal 21 .

Upon receiving the request from the customer terminal 21, the virtual space generator 32a of the information processing server 30 uses the virtual space data 33a to set the position of the second avatar A2 at a predetermined position in the virtual space VS ( step S13). The predetermined position is, for example, a position corresponding to the entrance of the virtual store.

The display data generator 32f of the information processing server 30 generates display data using the virtual space data 33a and the position information of the avatars A1 and A2 set by the virtual space generator 32a. The display data is transmitted from the communication unit 31 to the customer terminal 21 (step S14).

Upon receiving the display data, the customer terminal 21 displays an image based on the display data on the display unit. As a result, the basic screen 200 is displayed on the customer terminal 21 (step S15). That is, the display data generated in the process of step S14 in the basic function is data for displaying the basic screen 200. FIG. FIG. 4 shows an example of the basic screen 200. As shown in FIG. The basic screen 200 is a screen for the customer user P2 to look around the products in the virtual space VS by moving the second avatar A2.

By the customer user P2 performing various operations on the basic screen 200, the instruction information Is is input to the customer terminal 21, and the instruction information Is is transmitted from the customer terminal 21 to the information processing server 30 (step S16). Specifically, for example, by dragging on the basic screen 200, information indicating the moving direction and amount of movement of the second avatar A2 is input to the customer terminal 21 as the instruction information Is.

Upon receiving the instruction information Is, the virtual space generator 32a of the information processing server 30 changes the configuration of the virtual space VS according to the instruction information Is (step S17). Specifically, the virtual space generator 32a changes the position of the second avatar A2 according to the instruction information Is.

The display data generation unit 32f generates display data using the information changed by the virtual space generation unit 32a, and the display data is transmitted from the communication unit 31 to the customer terminal 21 (step S18).

By the customer terminal 21 displaying an image based on the display data on the display unit, the change corresponding to the instruction information Is is reflected on the basic screen 200 (step S19). Specifically, the position of the second avatar A2 moves.

Details of the basic screen 200 will be described with reference to FIG. The basic screen 200 includes a virtual area 210 in which an image of the virtual space VS is displayed, and an operation area 220 for accepting operations for changing various settings and using functions. The image of the virtual area 210 may be an image of the virtual space VS viewed from a viewpoint set around the second avatar A2 such as behind the second avatar A2, or an image of the virtual space VS viewed from the viewpoint of the second avatar A2. It may be an image looking at VS. Also, these viewpoints may be switchable.

A product display 211 showing information about the product is positioned where the product Gd is positioned in the virtual area 210 . The information about the product is, for example, the description of the product and the evaluation from the purchaser of the product. Note that the product display 211 may be displayed when the location where the product Gd is located is selected. The product display 211 may be a component of the virtual space VS. Alternatively, the product display 211 may not be a component of the virtual space VS, and the display data may be configured such that the product display 211 is displayed at a specific location within the image of the virtual space VS. Data required for drawing the product display 211 is stored in the storage unit 33 in advance.

Further, by selecting an arbitrary location within the virtual area 210, it may be possible to enlarge and display the selected location. By displaying a wide range of the virtual space VS, performing an operation to move the second avatar A2, and performing an operation to select the product Gd in an enlarged display, each operation can be performed efficiently. Such display switching may be performed by the customer terminal 21 without exchanging information with the information processing server 30 by generating data from the display data by the customer terminal 21 . Alternatively, information instructing switching of display is included in the instruction information Is and sent from the customer terminal 21 to the information processing server 30, and the display data reflecting the change according to the instruction information Is is sent from the information processing server 30 to the customer terminal. The display may be switched based on what 21 receives.

If the salesperson terminal 12 has an image display function, the salesperson terminal 12 may also be able to display the image of the virtual space VS. That is, in response to a request from the salesperson terminal 12, the information processing server 30 may transmit data for displaying the image of the virtual space VS to the salesperson terminal 12. FIG.

<Conversation function>
The conversation function is a function that realizes conversation between the salesperson user P1 and the customer user P2. For example, it is used when customer user P2 wants to ask salesperson user P1 about a product. First, the basic operation of the virtual space providing system 100 in the conversation function will be described.

As shown in FIG. 5, when the customer user P2 performs a predetermined operation on the customer terminal 21 to request a conversation with the first avatar A1, a conversation request for the selected first avatar A1 is sent to the customer. It is transmitted from the terminal 21 to the information processing server 30 (step S20). The predetermined operation is, for example, an operation of selecting the first avatar A1 displayed on the basic screen 200 and an area for instructing the start of conversation. By selecting the first avatar A1, the basic screen 200 may display an introduction of the salesperson user P1 corresponding to the first avatar A1.

Upon receiving the request from the customer terminal 21, the conversation processing unit 32b of the information processing server 30, via the communication unit 31, connects the salesperson terminal 12 of the salesperson user P1 corresponding to the target first avatar A1. call (step S21). As a result, the salesperson terminal 12 notifies of the incoming call by voice or vibration. Note that the correspondence between the first avatar A<b>1 and the salesperson terminal 12 may be performed in advance by the information processing server 30 .

When the salesperson user P1 operates the salesperson terminal 12 to respond to the call (step S22), conversation execution processing is performed in each of the customer terminal 21, the salesperson terminal 12, and the information processing server 30 (step S23). , S24, S25).

That is, the first conversation information Ic1 input to the salesperson terminal 12 is transmitted to the customer terminal 21 via the information processing server 30, and the customer terminal 21 outputs based on the first conversation information Ic1. The second conversation information Ic2 input to the customer terminal 21 is transmitted to the salesperson terminal 12 via the information processing server 30, and the salesperson terminal 12 outputs based on the second conversation information Ic2. As a result, a statement input to one terminal in the form of text, voice, or video is output to the other terminal, and a conversation is established between the salesperson user P1 and the customer user P2.

Thus, the conversation execution processing by the conversation processing unit 32b includes transmission of the first conversation information Ic1 received from the salesperson terminal 12 to the customer terminal 21, and sales of the second conversation information Ic2 received from the customer terminal 21. A process of instructing the communication unit 31 to transmit to the member terminal 12 is included.

Before the conversation between the salesperson user P1 and the customer user P2 is established, there are customer interactions with respect to the avatars A1 and A2, such as selection of the first avatar A1 as a conversation target and movement of the second avatar A2 to the area where the first avatar A1 is located. User P2's operation occurs. Moreover, it is preferable that the customer terminal 21 displays an indication that the first avatar A1 and the second avatar A2 are speaking during the conversation between the salesperson user P1 and the customer user P2. Thus, in the conversation between the salesperson user P1 and the customer user P2, the first avatar A1 and the second avatar A2 intervene for operations or displays related to the conversation.

The form of starting the conversation is not limited to the form in which the information processing server 30 calls the salesperson terminal 12 upon receiving a request from the customer terminal 21 . For example, the information processing server 30 may receive a reservation for the time and order of conversation from the customer terminal 21, and the customer terminal 21, the salesperson terminal 12, and the information processing server 30 may each start the conversation execution process according to the reservation.

Specifically, the storage unit 33 of the information processing server 30 stores reservation data including a table including reservation persons and reservation times. , the customer terminal 21 can confirm the reservation status of the conversation with the salesperson user P1. When the customer user P2 designates an available time in the reservation status, a reservation request is sent from the customer terminal 21 to the information processing server 30, and the conversation processing unit 32b reserves a conversation between the customer user P2 and the salesperson user P1. , the reservation for the specified time is registered in the reservation data. Then, the conversation is started according to the reservation in the reservation data. In this way, if it is possible to reserve a conversation, when customer user P2 wishes to have a conversation with salesperson user P1, even if salesperson user P1 is in the middle of serving customers and is unable to respond immediately, after that, You can reserve time in advance to talk to Therefore, convenience is enhanced for the customer user P2.

Further, the conversation may be started based on the information processing server 30 calling the customer terminal 21 in response to a request from the salesperson terminal 12 . Also, the means of conversation may be selectable at the customer terminal 21 or the salesperson terminal 12 .

FIGS. 6 and 7 show an example of the conversation screen 201 displayed on the customer terminal 21 during the execution of the conversation execution process when the means of conversation is animation. The conversation screen 201 includes, in addition to the virtual area 210 and the operation area 220 described above, an image area 230 in which an image of the salesperson user P1 in conversation captured by the salesperson terminal 12 is displayed. The image displayed in the image area 230 is an example of the first status display 300, which is a display showing the status of the first space RS1. In this case, the first status display 300 indicates the status of the first space RS1 based on the first conversation information Ic1 of the first information If1. The first conversation information Ic1 is composed of moving image data.

By displaying the image of the salesperson user P1 during the conversation, the customer user P2 can get a feeling similar to face-to-face conversation while communicating through the virtual space VS. Therefore, in activities in the virtual space VS, it becomes easier to feel a connection with reality.

As shown in FIG. 6, on the conversation screen 201, the virtual area 210 and the image area 230 may be arranged so that the image area 230 overlaps a part of the virtual area 210 with the virtual area 210 as the main part. Conversely, as shown in FIG. 7 , the virtual area 210 and the image area 230 may be arranged such that the image area 230 is the main part and the virtual area 210 overlaps a part of the image area 230 . Further, it may be possible to select which of the virtual area 210 and the image area 230 is the main one.

In any case, the virtual area 210 and the video area 230 are displayed simultaneously on one screen. That is, while the conversation execution process is being performed, the display data generation unit 32f of the information processing server 30 generates data for displaying the virtual area 210 and the video area 230 on one screen as display data for displaying the conversation screen 201. is generated and transmitted to the customer terminal 21 via the communication unit 31 . In this case, the first conversation information Ic1 is included in the display data and transmitted to the customer terminal 21 based on an instruction from the conversation processing section 32b.

By simultaneously displaying the virtual area 210 and the video area 230 on one screen, the customer user P2 gets both the feeling of shopping in the virtual space VS and the feeling close to conversation in the real space. be able to. Therefore, by combining these senses, it is possible to obtain a feeling that is closer to the experience in the real space as a feeling obtained by activities in the virtual space VS. Therefore, it becomes easier to feel a connection with reality.

If the means of conversation is a moving image, the salesperson terminal 12 may display only the image of the customer user P2 captured by the customer terminal 21, or the image of the customer user P2 and the image of the virtual space VS may be displayed. may be displayed.

Next, the conversation enable/disable decision processing by the conversation processing unit 32b will be described. In the conversation function, whether or not to have a conversation may be determined according to the distance between the first avatar A1 and the second avatar A2. In this case, upon receiving a request for conversation from the customer terminal 21 in the process of step S20 in FIG.

FIG. 8 shows the procedure of conversation decision processing. In the conversation determination process, the conversation processing unit 32b first calculates the distance L between the first avatar A1 and the second avatar A2 in the virtual space VS as the process of step S30.

Next, as the process of step S31, the conversation processing unit 32b determines whether or not the distance L is equal to or less than a predetermined threshold. The predetermined threshold is set to a distance at which conversation is possible between two persons when converted to a distance within the first space RS1.

If the distance L is equal to or less than the threshold (affirmative determination in step S31), the conversation processing unit 32b determines to permit conversation as the process of step S32, and terminates the conversation approval/disapproval determination process. If the conversation is permitted, the conversation processing unit 32b advances the processing from step S21 onward in FIG.

When the distance L exceeds the threshold (negative determination in step S31), the conversation processing unit 32b determines not to permit conversation as processing in step S33, and ends the conversation approval/disapproval determination process. When conversation is not permitted, the conversation processing unit 32b notifies the customer terminal 21 via the communication unit 31 that conversation cannot be performed due to the long distance between the avatars, and this notification is displayed on the customer terminal 21. .

According to the above configuration, when the customer user P2 wants to talk to the salesperson user P1, it is necessary to bring the second avatar A2 close to the first avatar A1. Moreover, if the customer user P2 wants to avoid being spoken to by the salesperson user P1, the second avatar A2 should be kept away from the first avatar A1. In this way, the distance between avatars affects whether or not a conversation can be held in the same way that the distance between a customer and a salesperson affects whether or not a conversation can be held in a real store. Therefore, the customer user P2 can obtain a feeling closer to the experience in the real space in the activity in the virtual space VS.

Next, conversation volume adjustment processing by the conversation processing unit 32b will be described. When the conversation means is audio or video, the conversation function may adjust the volume of conversation according to the distance between the first avatar A1 and the second avatar A2. In this case, the conversation processing unit 32b performs conversation volume adjustment processing prior to conversation execution processing.

FIG. 9 shows part of the processing flow of the virtual space providing system 100 when conversation volume adjustment processing is performed. In the conversation volume adjustment process, the conversation processing unit 32b first calculates the distance L between the first avatar A1 and the second avatar A2 (step S40). Then, the conversation processing unit 32b sets the conversation volume according to the distance L (step S41). Specifically, the conversation processing unit 32b sets the conversation volume to be lower as the distance L increases.

After that, the conversation processing unit 32b advances the conversation execution process at the set conversation volume. That is, when the first conversation information Ic1 input to the salesperson terminal 12 is transmitted (step S42), the conversation processing unit 32b sends the first conversation information Ic1 along with an instruction to output voice at the set conversation volume. , to the customer terminal 21 via the communication unit 31 (step S43). In this case, the first conversation information Ic1 is composed of audio data or includes audio data as a part of moving image data. As a result, the customer terminal 21 outputs the speech of the salesperson user P1 at the set conversation volume based on the first conversation information Ic1 (step S44).

According to the above configuration, the distance between avatars affects the volume of conversation in the same way that the distance between a customer and a salesperson affects the volume of conversation in a real store. Therefore, the customer user P2 can obtain a feeling closer to the experience in the real space in the activity in the virtual space VS.

By executing the conversation volume adjustment process at predetermined intervals even after the conversation execution process is started, or by executing it each time the first conversation information Ic1 is transmitted to the customer terminal 21, the distance between the avatars can be reduced during the conversation. When L changes, the conversation volume changes accordingly. Thereby, the customer user P2 can obtain a feeling closer to the experience in the real space.
Note that the conversation volume at the salesperson terminal 12 may be changed according to the distance L between the first avatar A1 and the second avatar A2, as with the customer terminal 21, or may be constant.

<Customer status display function>
The customer service status display function is a function in which the customer service status of the salesperson user P1 in the first space RS1 is reflected in the display of the first avatar A1. The salesperson user P1 also serves customers who have actually visited the first space RS1. Therefore, when the salesperson user P1 is serving customers in the first space RS1, the salesperson user P1 may A request for conversation from customer user P2 through space VS cannot be answered. The customer service status display function allows the customer user P2 to easily grasp whether or not the customer service by the salesperson user P1 using the first avatar A1 in the virtual space VS is possible.

FIG. 10 shows the procedure of processing of the information processing server 30 in the customer service status display function. First, as the process of step S50, the communication unit 31 of the information processing server 30 receives, from the first device 10, determination information Ij that is information that enables determination of the reception status of the salesperson user P1. When the information for determination Ij is received, the customer service status determination unit 32c of the information processing server 30 determines whether or not the salesperson user P1 is serving customers in the first space RS1 based on the information for determination Ij as the process of step S51. do.

For example, if the location information collection device 11 includes a camera and the salesperson user P1 is identified by analyzing the captured image when specifying the location of the salesperson user P1 using the location specifying information Ip, the same By analyzing the image, it is determined whether another person is located within a predetermined range from salesperson user P1. In this case, the information output from the position information collecting device 11 functions as the determination information Ij. The determination information Ij is included in the first information If1. The predetermined range is set to a range in which the other person is assumed to be located while the salesperson user P1 is having a conversation with the other person. The customer service status determination unit 32c determines that the salesperson user P1 is serving customers when another person is positioned within a predetermined range from the salesperson user P1.

When it is determined that the salesperson user P1 is serving a customer (affirmative determination in step S51), in the process of step S52, the display data generation unit 32f generates a customer service indicating that the first avatar A1 is serving a customer. Display data for displaying the basic screen 200 including the display is generated. By displaying the basic screen 200 based on this display data on the customer terminal 21, the display during service is displayed on the customer terminal 21 together with the image of the virtual space VS.

When it is determined that the salesperson user P1 is not serving customers (negative determination in step S51), in the process of step S53, the display data generation unit 32f generates display data for displaying the basic screen 200 that does not include the display of serving customers. Generate.

FIG. 11 shows an example of a basic screen 200 including a service in progress display 212 . In FIG. 11, a third avatar A3 different from the first avatar A1 and the second avatar A2 is placed near the first avatar A1, and they are in conversation between the first avatar A1 and the third avatar A3. There is an indication that The display indicating that the first avatar A1 is having a conversation with the third avatar A3 is the service in progress display 212 .

The in-service display 212 is not limited to the above example, and may be attaching a tag to the first avatar A1 indicating that the customer is in service, changing the color of the first avatar A1, or the like. The in-service display 212 may be displayed in association with the first avatar A1. The in-service display 212 has a function of indicating that the first avatar A1 is serving a customer and that the salesperson user P1 is serving a customer in the first space RS1. The customer service display 212 may be a component of the virtual space VS, or the customer service display 212 may be displayed near the first avatar A1 instead of being a component of the virtual space VS. The display data may be configured as follows. Data required for rendering the display 212 during service is stored in the storage unit 33 in advance.

Customer user P2 can easily recognize that salesperson user P1 corresponding to first avatar A1 is in a state of being unable to respond to a request for conversation from display 212 during customer service. Therefore, it is possible to adjust the timing of speaking to the first avatar A1, etc., and to efficiently proceed with activities in the virtual space VS.

Since the customer service display 212 indicates the customer service status of the customer user P2 in the first space RS1 in the virtual space VS, the first avatar A1 is not a character who only serves customers in the virtual space VS. It is easy for the customer user P2 to feel that he is the alter ego of the salesperson who is actually serving customers at the store in the real space. Therefore, in activities in the virtual space VS, it becomes easier to feel a connection with reality.

In addition, since the image of the virtual space VS and the display 212 during service are displayed on one screen at the same time, the connection between the activities in the virtual space VS and the reality can be felt more easily.
The in-service display 212 is an example of the first status display 300, which is a display indicating the status of the first space RS1, and is a display indicating the work status of the salesperson user P1. In this case, the first status display 300 shows the status of the first space RS1 based on the determination information Ij.

The determination as to whether or not the salesperson user P1 is serving customers is not limited to the information output by the position information collection device 11, and may be performed based on the information output by any device included in the first device 10. . In other words, the determination information Ij does not have to be the information output by the position information collecting device 11 as long as it is the information output by the first device 10 .

For example, the salesperson user P1 performs a predetermined operation on the salesperson terminal 12 when starting customer service in the first space RS1. As a result, information indicating that the salesperson user P1 is serving customers is transmitted from the salesperson terminal 12 to the information processing server 30 as the determination information Ij. Based on the reception of the information, the customer service situation determination unit 32c determines that the salesperson user P1 is in customer service.

In addition, not only when the salesperson user P1 is dealing with a customer who has visited the first space RS1, but also when the salesperson user P1 is on the phone, for example, the customer service situation determining unit 32c It may be determined that P1 is serving a customer, and the display 212 during customer service may be displayed. For example, the salesperson user P1 performs a predetermined operation on the salesperson terminal 12 when answering the phone. As a result, the salesperson terminal 12 transmits determination information Ij to the information processing server 30, and the customer service status determination unit 32c determines that the salesperson user P1 is serving customers.

In addition, not only during customer service, when the salesperson user P1 cannot respond to a request for conversation through the virtual space VS due to work in the first space RS1, the first situation display 300 indicates that the salesperson user P1 An indication may be displayed on the customer terminal 21 indicating that the request for conversation cannot be answered. Such a display is also included in the display showing the work status of salesperson user P1.

<Indoor shooting function>
The indoor photographing function is a function of photographing an image in the first space RS<b>1 such as an image of a product and displaying the photographed image on the customer terminal 21 . The indoor photography function is used, for example, when the customer user P2 wants to check the actual color and shape of the product.

As shown in FIG. 12, when the customer user P2 performs a predetermined operation on the customer terminal 21 to request photography in the first space RS1, the customer terminal 21 transmits a photography request to the information processing server 30. (step S60). The predetermined operation is, for example, an operation of selecting a shooting instruction area displayed on the basic screen 200 .

Upon receiving a request from the customer terminal 21 , the photographing instruction section 32 d of the information processing server 30 outputs a photographing instruction to the photographing device 13 . A photographing instruction is sent from the communication unit 31 to the photographing device 13 (step S61). Upon receiving the instruction to shoot, the shooting device 13 performs shooting processing (step S62). The shooting process includes a process of generating shooting information Iv by shooting in the first space RS<b>1 and transmitting the shooting information Iv to the information processing server 30 .

When the photographing device 13 can be remotely operated, the operation information Io is input to the customer terminal 21 and the operation information Io is transmitted from the customer terminal 21 to the information processing server 30 . In this case, the photographing instruction section 32d outputs a photographing instruction including a movement instruction according to the operation information Io. The photographing process of the photographing device 13 includes changes in position and orientation according to instructions from the information processing server 30 .

For example, the image of the virtual space VS displayed on the customer terminal 21 includes a display indicating the position of the photographing device 13, and the moving direction and the amount of movement of the photographing device 13 are specified by performing a drag operation on this display. The information is input to the customer terminal 21 as the operation information Io. For example, when the position of the salesperson user P1 is specified by analyzing an image captured by the position information collecting device 11, the position of the photographing device 13 may be specified by analyzing a similar image. Alternatively, the photographing device 13 has a function of acquiring its own position information and transmitting it to the information processing server 30, and based on the position information from the photographing device 13, the position of the photographing device 13 is specified, and the customer terminal 21 may be reflected in the display in

When the information processing server 30 receives the photographing information Iv from the photographing device 13, the display data generation unit 32f of the information processing server 30 generates display data for displaying the observation screen 202 including the image photographed by the photographing device 13. . The display data is transmitted from the communication section 31 to the customer terminal 21 (step S63).
Upon receiving the display data, the customer terminal 21 displays an image based on the display data on the display unit. As a result, the observation screen 202 is displayed on the customer terminal 21 (step S64).

FIG. 13 shows an example of the observation screen 202. As shown in FIG. The observation screen 202 includes, in addition to the virtual area 210 and the operation area 220, a photographing area 240 in which an image photographed by the photographing device 13 is displayed. The image displayed in the imaging region 240 is an example of the first situation display 300, which is a display showing the situation of the first space RS1. In this case, the first situation display 300 shows the situation of the first space RS1 based on the imaging information Iv of the first information If1.

On the observation screen 202 , as shown in FIG. 13 , the virtual area 210 and the imaging area 240 may be arranged so that the imaging area 240 overlaps a part of the virtual area 210 . Alternatively, the virtual area 210 and the imaging area 240 may be arranged such that the imaging area 240 is mainly used and the virtual area 210 overlaps a part of the imaging area 240 . Further, it may be possible to select which of the virtual area 210 and the photographing area 240 is the main one. In any case, the virtual area 210 and the shooting area 240 are displayed simultaneously on one screen. That is, the display data for displaying the observation screen 202 is data for displaying the virtual area 210 and the imaging area 240 on one screen.

By displaying the image captured by the imaging device 13 on the customer terminal 21, the customer user P2 can confirm the color and shape of the product. Therefore, the customer user P2 can select a product to purchase while referring to the appearance of such products. Therefore, it is possible to appropriately select a product, and it is possible to obtain a feeling similar to viewing and selecting a product in the real space. Therefore, in activities in the virtual space VS, it becomes easier to feel a connection with reality.

Furthermore, if the remote control of the imaging device 13 is possible, the image displayed in the imaging area 240 will reflect the will of the customer user P2 more strongly. Therefore, it becomes easy to advance selection of goods according to the intention of the customer user P2, and the customer user P2 can obtain a feeling closer to the selection of goods in the real space.

In addition, by simultaneously displaying the virtual area 210 and the photographing area 240 on one screen, the customer user P2 can experience the feeling of shopping in the virtual space VS and the feeling of selecting products in the real space. can get together. Therefore, by combining these senses, it is possible to obtain a feeling that is closer to the experience in the real space as a feeling obtained by activities in the virtual space VS. Therefore, it becomes easier to feel a connection with reality.

In addition, when the imaging device 13 can be operated remotely, it may be possible to reserve the use of the imaging device 13 . Thereby, the convenience for the customer user P2 is improved. Specifically, the storage unit 33 of the information processing server 30 stores reservation data including a table including reservation persons and reservation times. , the customer terminal 21 can confirm the reservation status of the use of the photographing device 13 . When the customer user P2 designates an available time in the reservation status, a reservation request is sent from the customer terminal 21 to the information processing server 30, and the photographing instruction unit 32d reserves the use of the photographing device 13 by the customer user P2 as follows: Register the reservation for the specified time in the reservation data. Then, according to the reservation in the reservation data, use of the photographing device 13 is started.

<Trial function>
The trial function is a function for virtually trialing a product.
As shown in FIG. 14, when customer user P2 performs a predetermined operation for requesting trial use of a product on customer terminal 21, a request for trial use is transmitted from customer terminal 21 to information processing server 30 (step S70). ). The predetermined operation is, for example, an operation of selecting a product displayed on the basic screen 200 and an area for instructing trial use of the product.

Upon receiving the request from the customer terminal 21, the trial execution unit 32e of the information processing server 30 performs trial processing (step S71). For example, if the product is clothes or accessories, the trial process is a process of generating data in which the product is attached to the second avatar A2 corresponding to the customer user P2. This is processing for generating data with A2 added. Alternatively, the trial process may be a process of generating data in which the second avatar A2 holds a product. Just do it.

Subsequently, the display data generation unit 32f of the information processing server 30 uses the data generated by the trial execution unit 32e to display the trial screen 203 including the image of the second avatar A2 trialing the product. Data is generated (step S72).

Upon receiving the display data, the customer terminal 21 displays an image based on the display data on the display unit. As a result, the trial screen 203 is displayed on the customer terminal 21 (step S73).
FIG. 15 shows an example of the trial screen 203. As shown in FIG. The trial screen 203 includes an operation area 220 and a trial area 250 in which the second avatar A2 who is using the product Gd on a trial basis is displayed.

The background of the trial area 250 may be an image of the virtual space VS or an image different from the virtual space VS. Further, if the customer terminal 21 has a photographing function, the background of the trial area 250 may be an image of the second space RS2 photographed by the customer terminal 21 . That is, the trial function may utilize augmented reality (AR).

By displaying an image in which the second avatar A2 is trying out the product Gd, the customer user P2 can imagine how the product will be used by him/herself, the balance when using a combination of multiple products, and the like. It's easy to do. In addition, even if the product is difficult to try in a store in the real space, such as a vehicle, by having the second avatar A2 try the product, it is possible to easily obtain an image of how the product will be used. Also, when AR is used, it is easy to imagine how the product Gd is used in the second space RS2. Therefore, it is possible to make an accurate judgment regarding the selection of the product to be purchased. Note that when AR is used, the second avatar A2 may not be displayed, and only the product Gd may be displayed.

When customer user P2 decides which product to purchase, settlement processing is performed. The payment processing may be performed by the information processing server 30, or may be performed by the server of the EC site through cooperation between the EC site operated by the store in the first space RS1 and the virtual space providing system 100. .

As described above, according to this embodiment, the following effects are obtained.
(1) The customer terminal 21 displays an image of the virtual space VS and a first situation display 300 showing the situation of the first space RS1. Therefore, customer user P2 is more likely to feel a connection with reality in activities in virtual space VS, compared to the case where only the image of virtual space VS is displayed and first situation display 300 is not displayed. Accordingly, even when it is difficult for the customer user P2 to go to the first space RS1, the activity in the virtual space VS allows the customer user P2 to get a feeling close to the activity in the first space RS1. Therefore, when the virtual space providing system 100 is used for selling products, it is also possible to increase the purchasing motivation of the customer user P2.

(2) The first conversation information Ic1 is composed of moving image data, and the first situation display 300 includes a display of an image of the salesperson user P1 who is having a conversation based on the first conversation information Ic1. According to this, the customer user P2 can obtain a feeling close to a face-to-face conversation in the conversation with the salesperson user P1 through the virtual space VS. Therefore, in activities in the virtual space VS, it becomes easier to feel a connection with reality.

(3) The larger the distance between the first avatar A1 and the second avatar A2, the smaller the volume of the voice output from the customer terminal 21 is set based on the first conversation information Ic1. According to this, the distance between avatars influences the volume of conversation in the same way that the distance between a customer and a salesperson influences the volume of conversation in a real store. Therefore, the customer user P2 can obtain a feeling closer to the experience in the real space in the activity in the virtual space VS.

(4) Whether or not to have a conversation is determined according to the distance between the first avatar A1 and the second avatar A2, and if the distance is equal to or less than a predetermined value, a process of establishing a conversation is performed. According to this, the distance between avatars affects whether or not conversation is possible in the same way that the distance between a customer and a salesperson affects whether or not conversation is possible in a real store. Therefore, the customer user P2 can obtain a feeling closer to the experience in the real space in the activity in the virtual space VS.

(5) The first status display 300 includes a serving display 212 indicating that the salesperson user P1 is serving a customer in the first space RS1. According to this, the customer user P2 can easily grasp whether or not the salesperson user P1 is in a situation where he/she can respond to the request for conversation, so that it is possible to adjust the timing of speaking to the first avatar A1, and so on. You can efficiently proceed with activities in VS. Moreover, the customer user P2 can easily sense that the first avatar A1 is not a character who serves customers only in the virtual space VS, but an alter ego of a salesperson who actually serves customers in the store in the real space. Therefore, in activities in the virtual space VS, it becomes easier to feel a connection with reality.

(6) The first situation display 300 includes an image within the first space RS1 based on the imaging information Iv. According to this, the customer user P2 can check the color and shape of the product and select the product to be purchased. Therefore, it is possible to appropriately select a product, and it is possible to obtain a feeling similar to viewing and selecting a product in the real space. Therefore, in activities in the virtual space VS, it becomes easier to feel a connection with reality.

(7) The photographing device 13 is configured to be movable in the first space RS1, and the information processing server 30 transmits a movement instruction to the photographing device 13 according to the operation information Io from the customer terminal 21 . According to this, since the photographing device 13 can be remotely operated by the customer user P2, the image of the first space RS1 displayed on the customer terminal 21 reflects the will of the customer user P2 more strongly. Therefore, it becomes easy to advance selection of goods according to the intention of the customer user P2, and the customer user P2 can obtain a feeling closer to the selection of goods in the real space.

(8) The image of the virtual space VS and the first situation display 300 are displayed on one screen on the customer terminal 21 . According to this, the customer user P2 can obtain both the feeling of being active in the virtual space VS and the feeling close to the experience in the real space. Therefore, by combining these senses, it is possible to obtain a feeling that is closer to the experience in the real space as a feeling obtained by activities in the virtual space VS. Therefore, in activities in the virtual space VS, it becomes easier to feel a connection with reality.

[Modification]
The above embodiment can be implemented with the following modifications.
- The image of the virtual space VS and the first situation display 300 do not have to be displayed on one screen on the customer terminal 21 . For example, the virtual area 210 and the image area 230 displaying the image of the salesperson user P1 and the photographing area 240 displaying the image photographed by the photographing device 13, which are the first situation display 300, are switched and displayed. may Even with such a configuration, the customer user P2 can easily feel a connection with reality, compared to a form in which only the image of the virtual space VS is displayed and the first situation display 300 is not displayed.

- The virtual space providing system 100 does not have to have all the functions described in the above embodiment. The virtual space providing system 100 is a system that enables communication between the salesperson user P1 and the customer user P2 through conversations involving avatars, and includes an image of the virtual space VS and at least one first situation display 300. Any system may be used as long as it is displayed on the customer terminal 21 .

- The virtual space generation unit 32a of the information processing server 30 may arrange in the virtual space VS an avatar corresponding to the customer actually visiting the first space RS1. The position of the customer is identified, for example, based on analysis of images captured by the position information collection device 11, and reflected in the position of the avatar within the virtual space VS. According to such a configuration, the customer user P2 can determine the degree of bustle of the store in the first space RS1 and the popular products in the first space RS1 depending on the number and positions of the avatars corresponding to the customers in the first space RS1 in the virtual space VS. etc. can be known.

- The virtual space generator 32a of the information processing server 30 may control the number of avatars in the virtual space VS within a predetermined range. For example, if the number of avatars corresponding to customers is too small, the customer user P2 will find it difficult to feel the hustle and bustle. It becomes difficult to move the second avatar A2 and select products. If the number of avatars in the virtual space VS is controlled to a certain extent, occurrence of these problems can be suppressed. For example, the virtual space generation unit 32a places avatars corresponding to some of the customers in the first space RS1 in the virtual space VS, thereby keeping the number of avatars in the virtual space VS within a predetermined range. good too. Alternatively, the virtual space generator 32a may increase the number of avatars in the virtual space VS to within a predetermined range by arranging avatars of customers who do not exist in the first space RS1 in the virtual space VS.

- After the basic screen 200 is displayed, when the first avatar A1 and the second avatar A2 move within the virtual space VS, only the position information of the avatars A1 and A2 is exchanged between the information processing server 30 and the customer terminal 21. The customer terminal 21 may perform the process of generating the image of the virtual space VS in which the changes in the positions of the avatars A1 and A2 are reflected. In other words, the information processing server 30 manages changes in the position information of the avatars A1 and A2, and the avatars A1 and A2 are moved by the customer terminal 21. FIG.

In this case, the movement of the position of the first avatar A1 is performed based on the information indicating the changed position of the first avatar A1 transmitted from the information processing server 30 to the customer terminal 21 based on the position specifying information Ip, The movement of the position of the second avatar A2 is performed based on the instruction information Is input to the customer terminal 21. FIG. In such a form, the customer terminal 21 functions as a virtual space generator that moves the avatars A1 and A2 within the virtual space VS. Further, in this case, the customer terminal 21 may take part of the function of generating the display data. That is, the control unit 32 of the information processing server 30 and the customer terminal 21 may function as the display data generation unit.

- The application of the virtual space providing system 100 is not limited to the sale of products. That is, the first space RS1 does not have to be a space in the store, the first user does not have to be a salesperson, and the second user does not have to be a customer. It is sufficient if the second user's avatar can perform the same type of activity as the activity performed in the first space RS1 in the virtual space VS while the first user's avatar actually existing in the first space RS1 is involved. For example, the first space RS1 may be an office or a tourist spot.

Above all, the virtual space providing system 100 is preferably used for providing services using exhibits. The exhibited item is not particularly limited as long as it is an item arranged in the first space RS1 and used for providing a service, such as merchandise to be traded, a sample of merchandise, an exhibit that is not subject to trade, or the like. Services using exhibits include, for example, sales of products, introduction of exhibits, and the like. The first space RS1 is, for example, a store, a showroom, an exhibition venue, a venue for various events, or the like. The first user is a person in charge of customer service who serves visitors to the first space RS1, and the second user is a person who receives service through the virtual space VS, in other words, a person who receives customer service.

The provision and enjoyment of services using exhibits has traditionally been carried out in real space. It is also important to increase the satisfaction of service recipients. Therefore, if the virtual space providing system 100 is used to provide a service using exhibits, a feeling close to the activity in the real space can be obtained, and the connection with reality can be easily felt. can be suitably increased.

- A plurality of virtual spaces VS may be generated for one first space RS1. Each virtual space VS has an arrangement of structures imitating the first space RS1. For example, a virtual space VS including an avatar corresponding to the second user of the group may be generated for each group to which the second user belongs, such as family members and friends who shop together. As a result, each group can relax and enjoy activities in the virtual space VS. The same first user avatar may be placed in each of the plurality of virtual spaces VS, or if there are a plurality of first users, different first user avatars may be placed in each virtual space VS. good too. It should be noted that not all the customer service representatives present in the first space RS1 need to be reflected in the avatars of the virtual space VS as the first user.

A1... First avatar A2... Second avatar Gd... Goods Ic1... First conversation information Ic2... Second conversation information If1... First information If2... Second information Ij... Judgment information Io... Operation information Ip... Position specifying information Is Instruction information Iv Photographing information P1 Salesperson user P2 Customer user RS1 First space RS2 Second space VS Virtual space 10 First device 11 Positional information collecting device 12 Salesperson terminal 13 Photographing device 20 Second device 21 Customer terminal 30 Information processing server 31 Communication unit 32 Control unit 32a Virtual space generation unit 32b Conversation processing unit 32c Service status determination unit 32d Shooting instruction unit 32e Trial execution unit 32f Display data generating unit 33 Storage unit 33a Virtual space data 100 Virtual space providing system 200 Basic screen 201 Conversation screen 202 Observation screen 203 Trial screen 210 Virtual area 211 Product display 212 Customer service display 220 Operation area 230 Video area 240 Shooting area 250 Trial area 300 First situation display

Claims (11)

First information output from a device located in a first space, and position specifying information that is information capable of specifying the position of the first user in the first space; a first receiving unit that receives the first information including at least one conversation information;
Second information output from a display terminal operated by a second user in a second space, comprising: instruction information indicating an instruction of the second user; and second conversation information indicating an utterance of the second user. a second receiving unit that receives the second information including at least
A first avatar, which is a first object, is displayed in a virtual space having an arrangement of structures imitating the first space in accordance with the movement of the first user in the first space based on the position specifying information. a virtual space generation unit that moves a second avatar, which is a second object, in accordance with an instruction from the second user based on the instruction information;
a conversation processing unit that uses the first conversation information and the second conversation information to perform a process of establishing a conversation between the first user and the second user interposed by the first avatar and the second avatar;
a display data generation unit that generates display data for displaying an image of the virtual space and a display indicating the situation of the first space based on the first information;
a transmitting unit configured to transmit the display data to the display terminal;
Information processing server. The first space is a space where services are provided using exhibits,
The first user is a customer service representative in the service,
The information processing server according to Claim 1, wherein said second user is a person who receives said service through said virtual space. the first conversation information is video data,
The information processing server according to claim 1 or 2, wherein the display indicating the situation of the first space includes an image of the first user based on the first conversation information. The information processing server according to any one of claims 1 to 3, wherein the display showing the situation of the first space includes a display showing the working situation of the first user in the first space. The first information includes determination information that is information that can determine the customer service situation of the first user in the first space,
The display indicating the state of the first space is a service-in-progress display indicating that the first user is in service in the first space, and the service-in-service display is displayed in association with the first avatar. including
3. The display data generating unit, when it is determined that the first user is serving a customer based on the determination information, generates the display data for displaying an image including the display of the customer being served. The information processing server described. The first information includes shooting information made up of shooting data in the first space,
The information processing server according to any one of claims 1 to 5, wherein the display indicating the situation of the first space includes an image in the first space based on the photographing information. a device located in the first space includes a photographing device that generates the photographing information and is configured to be movable in the first space;
the second information includes operation information that is information indicating an instruction to move the photographing device;
7. The information processing server according to claim 6, wherein the transmission unit transmits an instruction to move the imaging device according to the operation information to the imaging device. The information processing server according to any one of claims 1 to 7, wherein the display data is data for displaying an image of the virtual space and a display showing the situation of the first space on one screen. . each of the first conversation information and the second conversation information includes voice data;
The conversation processing unit sets the volume of the voice output based on the first conversation information to be smaller as the distance between the first avatar and the second avatar is larger,
The information processing according to any one of claims 1 to 8, wherein the transmission unit transmits to the display terminal an instruction to output a sound based on the first conversation information at a volume set by the conversation processing unit. server. The conversation processing unit determines whether or not to have a conversation according to the distance between the first avatar and the second avatar, and performs processing to establish the conversation when the distance is equal to or less than a predetermined value. The information processing server according to any one of 1 to 9. A first acquisition unit that acquires first information in a first space, and includes position specifying information that is information capable of specifying a position of a first user in the first space; the first acquisition unit that acquires the first information including at least one conversation information;
A second acquisition unit for acquiring second information in a second space, comprising: instruction information indicating an instruction based on an operation of a second user on a display terminal in the second space; the second acquisition unit that acquires the second information including at least two conversation information;
A first avatar, which is a first object, is displayed in a virtual space having an arrangement of structures imitating the first space in accordance with the movement of the first user in the first space based on the position specifying information. a virtual space generation unit that moves a second avatar, which is a second object, in accordance with an instruction from the second user based on the instruction information;
a conversation processing unit that uses the first conversation information and the second conversation information to establish a conversation between the first user and the second user through the first avatar and the second avatar; ,
a display data generation unit for generating display data for causing the display terminal to display an image of the virtual space and a display indicating the situation of the first space based on the first information;
A virtual space providing system.

Images