JP6619539B2 - Information management system and information management method - Google Patents

Description

  The present invention relates to an information management system and an information management method for managing information transmitted and received between remote locations via a communication network.

  In customer business such as sales of products and provision of services, it is important how to have contact with customers. In particular, for businesses that provide goods or services that are not cheap, such as real estate brokerage, life insurance sales, and travel agents, increasing the number of opportunities to meet customers leads to sales. However, in order to increase opportunities to meet customers in various locations, if a branch office or a branch office is newly set up, a large initial cost will be required for securing the location and construction costs, and this will be maintained. As a result, fixed costs such as rents and labor costs are continuously incurred. In addition, it is necessary to secure human resources because resident staff must be assigned at branch offices and branch offices. In this way, the establishment of a new branch or branch office places a large financial and human burden on the business.

  In recent years, a technology for providing a remote face-to-face service via the Internet for a business form in which a business operator and a customer face each other directly is also known (for example, see Patent Document 1).

Japanese Patent No. 2006-79195

  In case of remote face-to-face customer contact, each customer and business staff use a terminal connected via a communication network, face the camera installed in front of them, speak into the microphone, Communicate while looking at images of the other party's face and products displayed on the terminal screen. In other words, although communication through video and audio has been established, it does not share other sensations, so-called atmosphere. For this reason, it is difficult for the staff to convey an implicit message that the customer does not speak about, such as where the customer is interested in the products and services introduced by the staff and what the customer is not interested in. As a result, it becomes difficult for the staff to respond flexibly according to the customer's interests, and the service may deteriorate.

  The present invention has been made in view of the above, and it is possible to easily share the atmosphere of a place between a staff introducing a product or service and a customer browsing the product or service in a remote interview customer. An object of the present invention is to provide an information management system and an information management method.

  In order to solve the above problems, an information management system according to one aspect of the present invention provides at least an information management server having a storage unit that stores a plurality of types of image data related to a product or service, and the product or service. A staff terminal used by a staff of an operator, a staff terminal connected to the information management server via a communication network, and a customer terminal used by a customer, the information management server via the communication network And the customer terminal connected to the staff terminal, the information management server transmits image data related to a common product or service among the plurality of types of image data to the staff terminal and the customer terminal, respectively. The customer terminal displays an image based on the image data transmitted from the information management server. The first display unit has a display area of an image to be displayed on the first display unit according to the attitude of the customer terminal, and transmits information representing the attitude to the staff terminal. The staff terminal includes a second display unit that displays an image based on the image data transmitted from the information management server, and the second terminal displays the second information according to the information indicating the attitude transmitted from the customer terminal. The display area of the image displayed on the display unit is changed.

  The information management system is a second customer terminal different from the first customer terminal used by a customer, and is connected to the information management server, the staff terminal, and the customer terminal via the communication network. A second customer terminal, and the information management server may transmit the image data to at least the staff terminal and the customer terminal in response to an operation performed on the second customer terminal. .

  In the information management system, the information management server receives, from the plurality of types of image data, image data relating to a product or service that is common to the image data transmitted to the staff terminal and the customer terminal, to the second customer terminal The customer terminal further transmits information representing the attitude to the second customer terminal, and the second customer terminal displays an image based on the image data transmitted from the information management server. The display area of the image displayed on the third display unit may be changed according to the information representing the posture transmitted from the customer terminal.

  In the information management system, the staff terminal has a camera capable of shooting a video of the staff operating the staff terminal, and the video data generated by shooting with the camera is the customer terminal and the second customer. One of the customer terminal and the second customer terminal that receives the video data from the staff terminal displays the video based on the video data in real time. Also good.

  In the information management system, the second customer terminal sends a signal to the customer terminal to switch between display and non-display of the video on the customer terminal in response to an operation performed on the second customer terminal. And the customer terminal may switch between displaying and not displaying the video on the first display unit according to the signal.

  In the information management system, the staff terminal transmits and receives voice data in real time between at least one of the customer terminal and the second customer terminal, and the staff terminal, the customer terminal, and the second terminal When receiving the voice data, the customer terminal may reproduce the voice based on the received voice data in real time.

  In the information management system, the information management server transmits image data configured for stereoscopic viewing to the customer terminal, and the customer terminal performs stereoscopic viewing based on the image data configured for stereoscopic viewing. An image for use may be displayed on the first display unit.

  An information management method according to another aspect of the present invention is an information management method executed in an information management system connected to a communication network, and the information management system includes at least a plurality of types of image data related to goods or services. An information management server having a storage unit for storing, a staff terminal used by a staff of a business operator providing the product or service, a staff terminal connected to the information management server via a communication network, and a customer A customer terminal connected to the information management server and the staff terminal via the communication network, and from the information management server, a common of the plurality of types of image data Send image data related to goods or services to the staff terminal and the customer terminal, respectively. And at the customer terminal, an image based on the image data transmitted from the information management server is displayed on a first display unit of the customer terminal, and the first display is performed according to the attitude of the customer terminal. Based on the image data transmitted from the information management server in the staff terminal, changing the display area of the image displayed on the section, transmitting the information representing the attitude from the customer terminal to the staff terminal, and Displaying an image on a second display unit of the staff terminal, and changing a display area of the image displayed on the second display unit in accordance with the information indicating the posture transmitted from the customer terminal; , Including.

  According to the present invention, based on image data transmitted from the information management server, an image related to a common product or service is displayed on the staff terminal and the customer terminal, and the staff terminal and the customer terminal are respectively displayed according to the attitude of the customer terminal. Since the display area of the image displayed on the first and second display units is changed, the staff using the staff terminal can use the same product as the customer viewing the product or service displayed on the customer terminal. Or you can browse the service. Therefore, it is possible to easily share the atmosphere of the place between the staff and the customer.

It is a figure showing a schematic structure of an information management system concerning one embodiment of the present invention. It is a block diagram which shows schematic structure of the information management server shown in FIG. It is a figure which shows the outline of the database memorize | stored in the store management information storage part shown in FIG. It is a figure for demonstrating the outline | summary of the image data memorize | stored in the content image data memory | storage part shown in FIG. It is a block diagram which shows schematic structure of the staff terminal shown in FIG. It is a block diagram which shows schematic structure of the store terminal shown in FIG. It is a block diagram which shows schematic structure of the VR browsing terminal shown in FIG. It is a schematic diagram which shows a mode that the customer is using the VR browsing terminal. It is a schematic diagram which illustrates the booth in which a store terminal and a VR browsing terminal are installed. It is a sequence diagram of the display process of the content image performed in the information management system shown in FIG. It is a schematic diagram which illustrates the screen displayed on a store terminal. It is a schematic diagram which illustrates the screen displayed on a store terminal. It is a schematic diagram which illustrates the screen displayed on a store terminal. It is a schematic diagram which illustrates the screen displayed on a store terminal. It is a schematic diagram which illustrates the screen displayed on a store terminal. It is a schematic diagram which illustrates the screen displayed on a store terminal. It is a schematic diagram which illustrates the screen displayed on a store terminal. It is a schematic diagram which illustrates the screen displayed on a store terminal. It is a schematic diagram which illustrates the screen displayed on a store terminal. It is a schematic diagram which illustrates the screen displayed on a VR browsing terminal. It is a schematic diagram which illustrates the screen displayed on a store terminal. It is a sequence diagram which shows the remote consultation process performed in the information management system shown in FIG. It is a schematic diagram which illustrates the screen displayed on a staff terminal before the start of a remote consultation process. It is a schematic diagram which illustrates the screen displayed on a store terminal when a remote consultation process cannot be performed. It is a schematic diagram which illustrates the screen displayed on a staff terminal during a remote consultation process. It is a schematic diagram which illustrates the screen displayed on a store terminal during a remote consultation process. It is a schematic diagram which illustrates the screen displayed on a VR browsing terminal during a remote consultation process.

  Hereinafter, an information management system and an information management method according to embodiments of the present invention will be described with reference to the drawings. Note that the present invention is not limited by these embodiments. Moreover, in description of each drawing, the same code | symbol is attached | subjected and shown to the same part.

  FIG. 1 is a diagram showing a schematic configuration of an information management system according to an embodiment of the present invention. The information management system 1 shown in FIG. 1 transmits and receives information between a provider that provides a product or service and a customer who wants to provide the product or service, and interactively uses video and audio between the two. It is a system for realizing communication, and includes an information management server 10, a plurality of staff terminals 20a, 20b,... Used by a business operator (collectively referred to as staff terminal 20), and a store terminal used by a customer 30 and the VR browsing terminal 40. The information management server 10, the plurality of staff terminals 20, the store terminal 30, and the VR browsing terminal 40 are connected via a communication network N. The communication network N includes, for example, an Internet line, a telephone line, a LAN, a dedicated line, a mobile communication network, a communication line such as WiFi (Wireless Fidelity), Bluetooth (registered trademark), or a combination of these, wired, wireless Or any combination thereof.

  FIG. 2 is a block diagram illustrating a schematic configuration of the information management server 10. The information management server 10 is a device that manages information related to products or services, information related to businesses that provide the products or services, and the like, and is configured by, for example, a host computer having a high processing capacity. As illustrated in FIG. 2, the information management server 10 includes a communication interface 11, a storage unit 12, and a processor 13.

  The communication interface 11 connects the information management server 10 to the communication network N, and communicates with other devices connected to the communication network N. The communication interface 11 is configured using, for example, a soft modem, a cable modem, a wireless modem, an ADSL modem, or the like.

  The storage unit 12 is configured using a computer-readable storage medium such as a semiconductor memory such as a ROM or a RAM. The storage unit 12 includes, in addition to the operating system program and the driver program, an application program that executes various functions, a program storage unit 121 that stores various parameters used during the execution of these programs, and the information management system. 1 includes a store management information storage unit 122 that stores a database used in 1, and a content image data storage unit 123 that stores image data related to products or services handled in the information management system 1 (hereinafter referred to as content image data). .

  FIG. 3 is a diagram showing an outline of a database stored in the store management information storage unit 122. As shown in FIG. 3, the database stored in the store management information storage unit 122 includes an industry database DB1, an operator database DB2, a store database DB3, a category database DB4, a product (property) database DB5, A device database DB6 and a session database DB7 are included.

  The industry database DB1 is a database that stores information about the business types of businesses that use the information management system 1, and is a real estate brokerage, travel agency, life insurance agency, new or used car sales, car rental, Created for each industry, such as furniture sales. The information related to the type of business of the business includes information such as the business type code and the name of the business that uses the information management system 1 and the business ID.

  The business entity database DB2 is a database that stores information on businesses that use the information management system 1, and is created for each business operator. The information regarding the business includes information such as the business name, business ID, business type, product or service to be handled, and the like. These pieces of information are associated with the industry database DB1 of the industry to which the business belongs.

  The store database DB3 is a database that stores information related to actual stores, branch offices, branch offices, and the like (hereinafter collectively referred to as stores) of each business operator, and is created for each business operator. The information regarding the store includes information such as a store name, a store account, an address, an IP address of the staff terminal 20 installed in the store, a status of the staff terminal 20, and the like. Here, the staff terminal 20 is installed in each store registered in the store database DB3, and is operated by a staff who performs business in these stores. A plurality of staff terminals 20 may be installed in one store. The status of the staff terminal 20 includes power off, being away from the staff (that is, a state where the staff terminal 20 cannot be operated), and being seated (ie, a state where the staff terminal 20 can be operated).

  The category database DB4 is a database that stores information on the category of goods or services handled in the information management system 1, and is classified for each category such as real estate rental properties, real estate sales properties, pack trips, new cars, used cars, car rentals, and furniture. Created. The information regarding the category includes information such as the type of the product or service, the code (product code, service code) indicating the category of the product or service, and the like.

  The product (property) database DB5 is a database that stores information on products or services included in each category, and is created for each category of products or services. The information related to the product or service includes information for specifying the product or service and information related to the content of the product or service. As an example, the information on the product in the category of real estate rental, that is, the property to be rented, is the property name, property code, address, map information indicating the storage area (address) in which image data of the floor plan of the property is stored, It includes information such as shooting point information indicating the position on the floor plan where the property was shot and shooting information indicating a storage area (address) in which image (content image) data at each shooting point is stored. As another example, information on a product in a travel category, that is, a travel pack (tour), includes a product name (tour title), a product code, a travel destination area, a travel period, and image data of a map of the travel destination. Map information indicating the storage area (address) stored, shooting point information indicating the position on the map where the image was taken at the travel destination, and a storage area (address) where image (content image) data at each shooting point is stored ) Information such as shooting information. Information regarding such products or services is associated with a store database DB3 of a store that handles the products or services and a category database DB4 of a category to which the products or services belong.

  The device database DB6 is a database that stores information on the devices of the staff terminal 20, the store terminal 30, and the VR browsing terminal 40 for each device. The information about the device includes information such as the device ID, the device installation location, the authentication license, the device authority, and the IP address. Here, the authority of a device is a range of information that can be browsed on the device. Each terminal is given a license for authentication for connecting to the information management server 10 in advance, and the authority of the device is determined according to the type of license. When each terminal accesses the information management server 10, the information management server 10 authenticates with a license and determines information (authority) that can be browsed based on the license of the terminal.

  As will be described later, the store terminal 30 and the VR browsing terminal 40 are installed in a physically close place (for example, in the same booth 4) and used as a set. A set of the store terminal 30 and the VR browsing terminal 40 used in the set is managed by each license in the device database DB6. 1 shows one store terminal 30 and one VR browsing terminal 40, but a plurality of sets of store terminals 30 and VR browsing terminals 40 used in a set may be provided.

  The session database DB 7 stores information on a bidirectional communication session (so-called video chat) via video and audio between the staff terminal 20 and the store terminal 30 and the VR browsing terminal 40. Information about the session includes the name and ID of the session, the store account where the connected staff terminal 20 is installed (see store database DB3), the device ID of the connected staff terminal 20, the store terminal 30, and the VR browsing terminal 40 ( Information (see device database DB6).

  FIG. 4 is a diagram for explaining an overview of image data stored in the content image data storage unit 123. As shown in FIG. 4, the content image data storage unit 123 stores map image data M1 and three types of content image data M2, M3, and M4. Among these, the map image data M1 is image data of an image (map image) relating to an outline of a product or service such as a floor plan of a real estate property or a travel destination map of a travel pack. The content image data M2, M3, and M4 include preview images (moving images or still images) in which each room in the real estate is photographed, and images (same as above) in which the scenery and tourist attractions of the travel destination are reflected. It is image data of an image (content image) representing the content of the product or service itself. The content image is an image in which a range exceeding a general human visual field is captured, such as an omnidirectional image (an image obtained by capturing a 360 ° range from a certain point) or a panoramic image. Usually, a partial area (hereinafter referred to as a display area) of such a content image is cut out and displayed on a display unit included in each terminal of the staff terminal 20, the store terminal 30, and the VR browsing terminal 40.

  Three types of content images (content image data M2, M3, and M4) are created for the same product or service. The content image data M2, M3, and M4 have the same content but different image quality. Specifically, the content image data M2 for the staff terminal is image data that is used when the staff confirms the content being browsed by the customer at the staff terminal 20, and is relatively small in order to reduce the amount of data. The image quality is low. The content image data M3 for the store terminal is image data used when the customer views the content as a two-dimensional image on the store terminal 30, and has a higher image quality than the content image data M2 for the staff terminal. The content image data M4 for the VR browsing terminal is image data configured for stereoscopic viewing, and in order for the VR browsing terminal 40 to allow the customer to browse a realistic stereoscopic image, the content image data M3 for the store terminal is used. Even higher image quality than that.

  Referring again to FIG. 2, the processor 13 is configured by using, for example, a CPU (Central Processing Unit), and reads each server program stored in the program storage unit 121 to centralize each unit of the information management server 10. By controlling and transmitting / receiving information to / from various terminals of the information management system 1, various functions for providing information on products or services from the business operator to the customer are realized. Functions realized by the processor 13 reading a program stored in the program storage unit 121 include an information search unit 131, a screen creation unit 132, an image extraction unit 133, and a terminal connection unit 134.

  The information search unit 131 searches the database stored in the store management information storage unit 122 in response to the request transmitted from the store terminal 30, thereby extracting information on the store, product, or service of the business operator desired by the customer. .

  The screen creation unit 132 creates a screen including the information extracted by the information search unit 131 and transmits the screen to the store terminal 30 from the communication interface 11 via the communication network N.

  The image extraction unit 133 searches the content image data storage unit 123 in response to a request transmitted from the store terminal 30 to extract content image data related to a customer desired product or service.

  In response to the request transmitted from the store terminal 30, the terminal connection unit 134 calls the staff terminal 20 installed in a specific store or the like of a specific business operator, and the staff terminal 20, the store terminal 30, and the VR browsing terminal 40 To start a bidirectional communication session via video and audio.

  FIG. 5 is a block diagram illustrating a schematic configuration of the staff terminal 20. The staff terminal 20 is a terminal device used by a business staff at a store, and is configured by using, for example, a general-purpose desktop or notebook personal computer. The staff terminal 20 may be used by the staff of the business operator in daily work. When the staff terminal 20 is connected to the store terminal 30 and the VR browsing terminal 40, the staff terminal 20 transmits and receives video and audio to and from these terminals in real time, thereby allowing the staff to perform remote face-to-face customer contact. It is.

  As shown in FIG. 5, the staff terminal 20 includes a communication interface 21, a display unit 22, an operation input unit 23, a camera 24, a voice output / input unit 25, a storage unit 26, and a processor 27.

  The communication interface 21 connects the staff terminal 20 to the communication Internet N, and communicates with other devices connected to the communication network N.

  The display unit 22 is a display including a display panel such as a liquid crystal panel or an organic EL (electroluminescence) panel and a drive unit.

  The operation input unit 23 is an input device such as an operation button, a keyboard, a mouse, and a touch panel provided on the display unit 22, and inputs a signal corresponding to an operation performed from the outside to the processor 27.

The camera 24 is, for example, a web camera externally attached to a computer.
The voice input / output unit 25 is, for example, a general microphone and a sound player.

  The storage unit 26 is a computer-readable storage medium such as a semiconductor memory such as a ROM or a RAM. The storage unit 26 includes, in addition to the operating system program and the driver program, an application program that executes various functions, a program storage unit 261 that stores various parameters used during the execution of these programs, and the information management server 10. Content image data storage unit 262 for storing the content image data transmitted from.

  The processor 27 is configured by using, for example, a CPU, and comprehensively controls each unit of the staff terminal 20 by reading various programs stored in the program storage unit 261. Functional units realized by the processor 27 executing the program stored in the program storage unit 261 include a connection accepting unit 271, a display control unit 272, and a display switching unit 273.

  When the connection reception unit 271 receives the connection request transmitted from the store terminal 30, the connection reception unit 271 receives the connection request in accordance with a signal input from the operation input unit 23, and the images of the store terminal 30 and the VR browsing terminal 40. And a two-way communication session via voice is started.

The display control unit 272 controls display of various information and images on the display unit 22.
The display switching unit 273 switches whether to transmit video data captured by the camera 24 to the VR browsing terminal 40 in accordance with a signal input from the operation input unit 23.

  FIG. 6 is a block diagram illustrating a schematic configuration of the store terminal 30. The store terminal 30 is one of terminal devices (customer terminals) used by customers who use products or services provided by a business, and is configured using a general-purpose desktop or notebook personal computer, tablet terminal, or the like. Is done. Preferably, a tablet terminal is used so that a wide range of users can operate intuitively. When the store terminal 30 is connected to the staff terminal 20, the store terminal 30 transmits and receives video and audio in real time with the staff terminal 20, thereby realizing a remote conversation between the customer and the staff of the business operator.

  As shown in FIG. 6, the store terminal 30 includes a communication interface 31, a display unit 32, an operation input unit 33, a camera 34, a voice input / output unit 35, a storage unit 36, and a processor 37.

  The communication interface 31 connects the store terminal 30 to the communication Internet N and communicates with other devices connected to the communication network N.

  The display unit 32 is a display including a display panel such as a liquid crystal panel or an organic EL panel and a drive unit.

  The operation input unit 33 is an input device such as an operation button or a touch panel provided on the display unit 32, and inputs a signal corresponding to an operation performed from the outside to the processor 37.

The camera 34 is a camera built in the store terminal 30, for example, and takes a video of a customer who operates the store terminal 30 to generate video data.
The voice input / output unit 35 is, for example, a general microphone and a sound player.

  The storage unit 36 is a computer-readable storage medium such as a semiconductor memory such as a ROM or a RAM. In addition to the operating system program and the driver program, the storage unit 36 stores a program storage unit 361 that stores application programs that execute various functions, various parameters, and the like, and a content image that stores content image data transmitted from the information management server 10 A data storage unit 362.

  The processor 37 is configured using, for example, a CPU, and comprehensively controls each unit of the store terminal 30 by reading various programs stored in the program storage unit 361. Functional units realized by the processor 37 executing the program stored in the program storage unit 361 include a connection request unit 371, a display control unit 372, and a display switching unit 373.

  The connection request unit 371 transmits, to the information management server 10, a connection request for starting a two-way communication session with the staff terminal 20 via video and audio according to a signal input from the operation input unit 33. .

The display control unit 372 controls display of various information and images on the display unit 32.
The display switching unit 373 generates a signal for switching whether to display the video based on the video data transmitted from the staff terminal 20 on the VR viewing terminal 40 according to the signal input from the operation input unit 33. And output from the communication interface 31.

  FIG. 7 is a block diagram illustrating a schematic configuration of the VR browsing terminal 40. FIG. 8 is a schematic diagram illustrating a state in which the customer is using the VR browsing terminal 40. The VR browsing terminal 40 is another terminal device (customer terminal) used by a customer who uses a product or service provided by a business operator, and is particularly configured to stereoscopically view a content image of the product or service. It is.

  As the VR browsing terminal 40, for example, a general-purpose device including a display unit such as a smartphone, a personal digital assistant (PDA), and a portable game device can be used. For example, when a smartphone is used as the VR browsing terminal 40, the customer 2 can view the display unit in a hands-free manner by attaching the smartphone to the holder 3 with the side on which the display unit is provided facing the user. Inside the holder 3, two lenses are respectively attached at positions corresponding to the left and right eyes of the customer 2. When the customer 2 causes the image to be stereoscopically viewed, two images with parallax are displayed on the display unit 42. The customer 2 can recognize the image shown on the display unit as a three-dimensional object by viewing these two images through the two lenses in the holder 3.

  However, the appearance of the VR browsing terminal 40 is not limited to that shown in FIG. For example, an image display device dedicated to stereoscopic viewing in which a device having an image display function such as a smartphone and a holder are integrated may be used. Such a dedicated image display device is also called a head mounted display.

  As shown in FIG. 7, the VR browsing terminal 40 includes a communication interface 41, a display unit 42, an operation input unit 43, a camera 44, a voice input / output unit 45, a sensor unit 46, a storage unit 47, And a processor 48.

  The communication interface 41 connects the VR browsing terminal 40 to the communication Internet N, and performs communication between other devices connected to the communication network N, specifically, the information management server 10 and the store terminal 30.

The display unit 42 is a display including a display panel such as a liquid crystal panel or an organic EL panel and a driving unit.
The operation input unit 43 is an input device such as an operation button or a touch panel provided on the display unit 42, and inputs a signal corresponding to an operation performed from the outside to the processor 48.

  The camera 44 is a camera built in the VR browsing terminal 40, for example. When the VR browsing terminal 40 is not a general-purpose device such as a smartphone but an image display device dedicated to stereoscopic viewing, the camera 44 may not be provided.

The voice input / output unit 45 is, for example, a general microphone and a sound player.
The sensor unit 46 includes various sensors such as a gyro sensor 461 and an acceleration sensor 462, and outputs a detection signal that represents a change in the orientation or inclination of the VR browsing terminal 40.

  The storage unit 47 is a computer-readable storage medium such as a semiconductor memory such as a ROM or a RAM. The storage unit 47 stores, in addition to the operating system program and driver program, a program storage unit 471 that stores application programs that execute various functions, various parameters, and the like, and content image data that is transmitted from the information management server 10 And a data storage unit 472.

  The processor 48 is configured using, for example, a CPU, and comprehensively controls each unit of the VR browsing terminal 40 by reading various programs stored in the program storage unit 471. Functional units realized by the processor 48 executing the program stored in the program storage unit 471 include an attitude information acquisition unit 481, a display control unit 482, and a display switching unit 483.

  The posture information acquisition unit 481 detects information indicating the posture of the VR browsing terminal 40 from the detection signal output from the sensor unit 46, that is, changes in orientation (azimuth angle) and inclination (elevation angle), and the direction of the change. And information indicating the amount of change (hereinafter referred to as posture information). The output attitude information is input to the display control unit 482 and transmitted to the store terminal 30 and the staff terminal 20 with the session established by the communication interface 41.

  The display control unit 482 changes the content image displayed on the display unit 42 based on the posture information output from the posture information acquisition unit 481.

  The display switching unit 483 determines whether or not to display the video based on the video data transmitted from the staff terminal 20 on the display unit 42 according to the signal transmitted from the store terminal 30 and input via the communication interface 41. Switch.

  The place where the store terminal 30 and the VR browsing terminal 40 are installed is not particularly limited as long as it can be connected to the communication network N. Preferably, it may be installed in a facility such as a shopping mall, a shopping center, a station premises, or a station building so that a wide range of customers can use the store terminal 30 and the VR browsing terminal 40. Further, the store terminal 30 and the VR browsing terminal 40 may be installed at a counter or the like provided in the facility as described above, or may be installed in a dedicated booth. Of course, the store terminal 30 and the VR browsing terminal 40 may be installed in a public facility such as an individual's home, workplace, or community center, an office, or the like.

  FIG. 9 is a schematic view illustrating a booth where the store terminal 30 and the VR browsing terminal 40 are installed. Inside the booth 4 shown in FIG. 9, a bench 4a and a shelf 4b are provided. The screen of the store terminal 30 is fitted into one surface of the shelf 4b. Further, the VR browsing terminal 40 is placed on the upper surface of the shelf 4b. FIG. 9 shows a state in which two sets of the store terminal 30 and the VR terminal 40 (two various terminals are installed) are installed. The customer can enter the booth 4 and sit on the bench 4a to operate the store terminal 30 or wear the VR browsing terminal 40 to acquire information on a desired product or service.

  As shown in FIG. 9, a plurality of customers can enter the booth 4. As will be described later, since the content image is displayed in synchronization between the store terminal 30 and the VR browsing terminal 40 used in the set, for example, one customer views the display unit 32 of the store terminal 30. Another customer can wear the VR browsing terminal 40 and use the same content image while browsing the same content image.

  Next, the operation of the information management system 1 will be described. FIG. 10 is a sequence diagram of content image display processing executed in the information management system 1. FIG. 11 to FIG. 19 and FIG. 21 are schematic views illustrating screens displayed on the store terminal 30. FIG. 20 is a schematic view illustrating a screen displayed on the VR browsing terminal 40.

  When the store terminal 30 accesses the information management server 10 (step S201), the information management server 10 transmits a service selection screen A1 illustrated in FIG. 11 to the store terminal 30 (step S101). In response to this, the store terminal 30 displays the received screen on the display unit 32 (step S202). As shown in FIG. 11, the service selection screen A <b> 1 displays “rental real estate (acquisition of real estate rental information)”, “buy real estate (acquisition of real estate sales information)”, “shopping” as services available to customers. , Icons a11 to a15 on which texts such as “going to travel (acquisition of travel information)” and “selecting life insurance (acquisition of life insurance information)” are displayed.

  When a predetermined operation (for example, a tap operation) is performed on any of the icons a11 to a15 in the store terminal 30, the store terminal 30 sends a request signal for a screen corresponding to the operated icon to the information management server 10. Transmit (step S203).

  When the information management server 10 receives the screen request signal, the information management server 10 searches the database stored in the store management information storage unit 122 to extract necessary information, and a screen including the extracted information (that is, the requested screen). Is transmitted to the store terminal 30. (Step S102). The store terminal 30 displays the received screen on the display unit 32 (step S204).

  In this way, when the customer performs a predetermined operation on the screens sequentially displayed on the store terminal 30, these steps S203, S102, and S204 are repeated, and the customer can approach the desired information. A mode in which the customer himself / herself operates the store terminal 30 to search for desired information is called a self mode.

  For example, in the service selection screen A1 shown in FIG. 11, when a predetermined operation is performed on the icon a11 displayed as “borrow real estate”, the information management server 10 searches the search method selection screen A2 (see FIG. 12). Is transmitted to the store terminal 30 for display.

  The search method selection screen A2 shown in FIG. 12 includes icons a21 and a22 displaying texts “select a store” and “select by area”, respectively. When a predetermined operation is performed on the icon a21 on the search method selection screen A2, the information management server 10 selects an operator associated with the real estate brokerage information stored in the industry database DB1 (see FIG. 3). An operator selection screen A3 (see FIG. 13) extracted from the operator database DB2 and including the extracted information is transmitted to the store terminal 30 and displayed.

  The business operator selection screen A3 shown in FIG. 13 includes a plurality of icons a31, a32, and a33 each displaying the extracted business name (A real estate, B real estate, and C real estate). For example, when a predetermined operation is performed on the icon a31 on the business operator selection screen A3, the information management server 10 extracts a store associated with the business operator (A real estate) displayed on the icon a31 from the store database DB3. Then, the store selection screen A4 (see FIG. 14) including the extracted information is transmitted to the store terminal 30 and displayed.

  The store selection screen A4 shown in FIG. 14 includes a plurality of icons a41, a42,... Each displaying a store name (XX station store, ΔΔ store,...) Associated with A real estate. In the store selection screen A4, for example, when a predetermined operation is performed on the icon a41, the information management server 10 extracts information about the store (the station in front of the station) displayed on the icon a41 from the store database DB3. Store information screen A5 (refer to Drawing 15) containing the information which was done is transmitted to store terminal 30, and is displayed.

  The store information screen A5 shown in FIG. 15 includes a property information display field a51 in which information on products (real estate properties) handled by the store, a store information display field a52 in which information on the store is displayed, and a consultation start button. a53 is included. When a predetermined operation is performed on one of the texts of a plurality of properties displayed in the store information display field a52 on the store information screen A5, the information management server 10 displays information on the property corresponding to the operated text. Is extracted from the product (property) database DB5, and a property information screen A6 (see FIG. 16) including the extracted information is transmitted to the store terminal 30 and displayed.

  The property information screen A6 shown in FIG. 16 includes a property information display field a61 in which information such as the name and location of the property is displayed, a preview button a62 in which a text “view” is displayed, and “speak to staff” And a consultation start button a63 on which a text such as “” is displayed.

  On the other hand, when a predetermined operation is performed on the icon a22 on the search method selection screen A2 shown in FIG. 12, the information management server 10 transmits the area selection screen A7 (see FIG. 17) to the store terminal 30 for display. Let Thereafter, the information management server 10 sequentially displays a screen for gradually narrowing down the area on the store terminal 30, and finally refers to the product (property) database DB5, and the property selection screen A8 (see FIG. 18). Is transmitted to the store terminal 30 for display.

  In the property selection screen A8 shown in FIG. 18, information on a plurality of properties existing in the selected area is listed. When a predetermined operation is performed on one of the texts of a plurality of listed properties on the property selection screen A8, the information management server 10 displays information on the property corresponding to the operated text in the product (property) database. The property information screen A6 (see FIG. 16) extracted from the DB 5 and including the extracted information is transmitted to the store terminal 30 and displayed.

  When a predetermined operation is performed on the preview button a62 on the property information screen A6 shown in FIG. 16, the store terminal 30 transmits a content image browsing request signal to the information management server 10 (step S205). In response to this, the information management server 10 extracts the content image data M3 and M4 of the requested content (that is, the selected property) from the content image data storage unit 123. Then, the content image data M3 for the store terminal is transmitted to the store terminal 30, and the content image data M4 for the VR viewing terminal is transmitted to the VR viewing terminal 40 (step S103).

  In response to this, the store terminal 30 stores the received content image data M3 in the content image data storage unit 362 (step S206). Further, the VR browsing terminal 40 stores the received content image data M4 in the content image data storage unit 472 (step S301).

  Subsequently, the information management server 10 transmits a browsing start screen A9 shown in FIG. 19 to the store terminal 30 (step S104), and the store terminal 30 displays the received browsing start screen A9 (step S207). The browsing start screen A9 includes a message display field a91 in which a message for a customer who operates the store terminal 30 is displayed, and a start button a92.

  When the store terminal 30 detects a predetermined operation (for example, a tap operation) on the start button a92, the store terminal 30 transmits a browsing start signal to the information management server 10 (step S208), and the information management server 10 further transmits the browsing start signal to the VR browsing. It transmits to the terminal 40 (step S105). In response to this, the VR browsing terminal 40 starts displaying the content image (that is, the image inside the property) based on the content image data M4 stored in the content image data storage unit 472 (step S302). As shown in FIG. 20, in the VR browsing terminal 40, two images each having a parallax are displayed in the two areas 42 a and 42 b of the display unit 42. The customer wearing the VR browsing terminal 40 can stereoscopically view the content image by viewing the images displayed in the areas 42a and 42b with the left and right eyes.

  The store terminal 30 also displays the browsing screen A10 shown in FIG. 21 on the display unit 32, and starts displaying a content image based on the content image data M2 stored in the content image data storage unit 362 (step S209). The browsing screen A10 includes a content image display field a93 in which a content image is displayed, and a consultation start button a94 on which a text such as “Talk with staff” is displayed.

  When the customer wearing the VR browsing terminal 40 moves his / her head and the posture (orientation and inclination) of the VR browsing terminal 40 changes, the VR browsing terminal 40 provides information (posture information) indicating the change of posture. At the same time, the attitude information is transmitted to the store terminal 30 (step S303). Communication between the store terminal 30 and the VR browsing terminal 40 may be performed via the information management server 10 or directly. For example, a communication network between a store terminal 30 and a VR browsing terminal 40 that are set and used by using a peer-to-peer communication technique called WebRTC (Web Real-Time Communication). Various data can be transmitted and received via N without going through the information management server 10. Alternatively, the store terminal 30 and the VR browsing terminal 40 may be paired in advance, and short-range wireless communication may be performed between them.

  The VR browsing terminal 40 reads the content image data M4 from the content image data storage unit 472 based on the acquired posture information, thereby changing the display area of the content image displayed on the display unit 42 (step S304). For example, as shown in FIG. 20, when a customer wearing the VR browsing terminal 40 turns his head upward from a state where the kitchen is displayed on the display unit 42, the area on the ceiling side of the kitchen is displayed on the display unit. 42. As a result, the customer wearing the VR browsing terminal 40 can experience a realistic feeling as if he / she is in the same space as the property (that is, inside the property) and is browsing the property.

  Further, when the store terminal 30 receives the posture information transmitted from the VR browsing terminal 40, the store terminal 30 reads the content image data M3 from the content image data storage unit 362 based on the posture information and displays it on the display unit 32. The display area of the content image is changed (step S210). That is, the content image in the same display area as the content image displayed on the VR browsing terminal 40 is displayed two-dimensionally on the store terminal 30. Thus, by displaying the content image in synchronization between the VR browsing terminal 40 and the store terminal 30, the customer browsing the store terminal 30 is the same as the customer wearing the VR browsing terminal 40. You can browse the property from a viewpoint.

  FIG. 22 is a sequence diagram showing remote consultation processing executed in the information management system 1. FIG. 23 is a schematic view illustrating a screen displayed on the staff terminal 20 before the start of the remote consultation process. FIG. 24 is a schematic view illustrating a screen displayed on the store terminal 30 when the remote consultation process cannot be executed. FIG. 25 is a schematic view illustrating a screen displayed on the staff terminal 20 during the remote consultation process. FIG. 26 is a schematic view illustrating a screen displayed on the store terminal 30 during the remote consultation process. FIG. 27 is a schematic view illustrating a screen displayed on the VR browsing terminal 40 during the remote consultation process.

  When the store terminal 30 detects a predetermined operation (for example, a tap operation) on the consultation start button a63 displayed on the property information screen A6 shown in FIG. 16 or the consultation start button a94 displayed on the browsing screen A10 shown in FIG. Then, a connection request signal for requesting connection by communication with the staff terminal 20 is transmitted to the information management server 10 (step S311). In response to this, the information management server 10 searches the store management information storage unit 122 and transmits a connection request signal to the staff terminal 20 installed in the store that handles the property being browsed in the store terminal 30 (step S111). . At this time, if “select a store” is selected on the search method selection screen A2 shown in FIG. 12, the information management server 10 is installed in the store selected by the customer among the stores handling the property being browsed. A connection request signal is transmitted to the staff terminal 20. On the other hand, when “select area” is selected on the search method selection screen A2 shown in FIG. 12, the information management server 10 extracts a store that handles the property being browsed and transmits a connection request signal.

  The unconnected screen B1 illustrated in FIG. 23 is displayed on the staff terminal 20 before the start of the remote consultation process. The unconnected screen B1 displays a property display field b11 in which properties handled by the store are listed, a property detail information display field b12 in which detailed information on the property selected in the property display field b11 is displayed, and a floor plan. A floor plan display field b13, a connection status display field b14 in which the connection status with the store terminal 30 is displayed, a customer video display field b15 in which a real-time video taken by the camera 34 of the store terminal 30 is displayed, And a content image display field b16 in which content images are displayed. When a connection request signal is transmitted from the information management server 10, text, a mark, and the like indicating that a call is in progress and a connection button b17 are displayed in the connection status display field b14.

  Here, while the status of the staff terminal 20 is “being away” in the store database DB3 (see FIG. 3), the staff terminal 20 and the store terminal 30 cannot be connected. Therefore, when the store terminal 30 is selected when the status of all the staff terminals 20 is “separated” at a certain store, the browsing screen of the store terminal 30 is displayed as shown in FIG. The consultation start button a94 in A10 ′ indicates that the staff is away. In this case, the customer cannot operate the consultation start button a94. When “select area” is selected on the search method selection screen A2 shown in FIG. 12, the information management server 10 determines that the staff terminal whose status is “seated” from the store database DB3 that handles the property being browsed. 20 is extracted, and connection request signals are transmitted in order of priority.

  When the staff terminal 20 detects a predetermined operation (for example, a click operation using a mouse) on the connection button b17 on the unconnected screen B1 shown in FIG. 23, the staff terminal 20 transmits a connection permission signal to the information management server 10 (step S211). . In response to this, the information management server 10 stores, in the session database DB7, the store terminal 30 that is the transmission source of the connection request signal, the VR browsing terminal 40 that is used in combination with the store terminal 30, and the transmission source of the connection permission signal. A new session with the staff terminal 20 is registered (step S112). As a result, the registered store terminal 30, the VR browsing terminal 40, and the staff terminal 20 are in a state in which bidirectional communication via video and audio is possible. When the session is registered, a connection screen B2 shown in FIG. 25 is displayed on the display unit 22 of the staff terminal 20. In the connection screen B2, detailed information regarding the property being viewed on the store terminal 30 is displayed in the property detailed information display field b12.

  When registering a new session, the information management server 10 transmits map image data M1 and content image data M2 (see FIG. 4) of the property being browsed in the store terminal 30 and the VR browsing terminal 40 to the staff terminal 20 (step) S113). The staff terminal 20 stores the received map image data M1 and content image data M2 in the content image data storage unit 262 (step S212), and starts displaying the content image (step S213).

  Thereby, the floor plan display column b13 of the connection screen B2 displays the floor plan of the property being browsed on the store terminal 30, and the content image display column b16 displays the content image of the property (that is, the image inside the property). Is displayed. The floor plan display field b13 also serves as an operating means for changing the display of the content image displayed in the content image display field b16. Specifically, when a pointing operation using a mouse or the like is performed on a desired point in the floor plan display field b13, an image displayed in the content image display field b16 corresponds to a point corresponding to the operated point. It changes to the image seen from the position in the property.

  The staff terminal 20 transmits video data (video data) captured by the camera 24 and audio data (audio data) collected by the audio input / output unit 25 (step S214). The store terminal 30 reproduces the staff's video and audio based on the received video data and audio data (step S312). As shown in FIG. 26, the display unit 32 of the store terminal 30 is provided with a real-time video display field b21 in addition to the content image display field a93, and the staff's video is displayed in real time in the real-time video display field b21. The

  Also, the VR browsing terminal 40 reproduces the staff's video based on the video data transmitted from the staff terminal 20 (step S411). As shown in FIG. 27, the display unit 42 of the VR browsing terminal 40 is provided with a real-time video display field b31 in a part of the content image, and the staff video is displayed in real time here. In the real-time video display field b31, the presence or absence of display can be changed by operating a real-time video deletion button b22 provided on the display unit 32 of the store terminal 30. In addition, by transmitting and receiving voice data between the VR browsing terminal 40 and the staff terminal 20, the voice of the staff is reproduced in the VR browsing terminal 40, or the voice of the customer wearing the VR browsing terminal 40 in the staff terminal 20 is reproduced. It can also be played back.

  The store terminal 30 transmits video data (video data) captured by the camera 34 and audio data (audio data) collected by the audio input / output unit 35 (step S313). The staff terminal 20 reproduces the customer video and audio based on the received video data and audio data (step S215). As shown in FIG. 25, in the customer video display field b15 of the connection screen B2 of the staff terminal 20, the video of the customer who operates the store terminal 30 is displayed in real time.

  Note that transmission and reception of video data and audio data among the staff terminal 20, the store terminal 30, and the VR browsing terminal 40 may be performed via the communication network N and the information management server 10, or a communication session may be performed. If it is after the establishment, it may be directly transmitted / received via the communication network N. For example, by using the WebRTC described above, video data, audio data, and various other data can be transmitted and received between the staff terminal 20, the store terminal 30, and the VR browsing terminal 40 without going through the information management server 10. it can.

  When the customer wearing the VR browsing terminal 40 moves his / her head and the posture of the VR browsing terminal 40 changes, the VR browsing terminal 40 acquires the posture information and stores it, as in step 303 of FIG. The data is transmitted to the terminal 30 and also to the staff terminal 20 (step S412).

  The VR browsing terminal 40 changes the display area of the content image displayed on the display unit 42 based on the acquired posture information, similarly to step S304 in FIG. 10 (step S413). Further, the store terminal 30 also changes the display area of the content image displayed on the display unit 32 based on the attitude information transmitted from the VR browsing terminal 40 (step S314), similarly to step S210 of FIG.

  The staff terminal 20 changes the display area of the content image displayed in the content image display field b16 by reading the content image data M2 from the content image data storage unit 262 based on the attitude information transmitted from the VR browsing terminal 40. (Step S216). That is, the content image in the same display area as the content image displayed on the VR browsing terminal 40 is two-dimensionally displayed in the content image display area b15 of the staff terminal 20. In this way, by displaying the content images in synchronization between the VR browsing terminal 40 and the staff terminal 20, the staff who operates the staff terminal 20 has the same viewpoint as the customer wearing the VR browsing terminal 40. Thus, the property can be inspected, and the part that the customer is paying attention to or the part that shows interest can be grasped.

  The real-time video display field b31 displayed on the VR browsing terminal 40 can also be deleted from the staff terminal 20 side. Specifically, a predetermined operation (for example, a click operation using a mouse) may be performed on the real-time video deletion button b18 provided on the connection screen B2.

  As described above, when a content image is displayed on each terminal in a state where a communication session is established among the staff terminal 20, the store terminal 30, and the VR browsing terminal 40, the staff is displayed according to the movement of the VR browsing terminal 40. The display area of the content image displayed on the terminal 20 and the store terminal 30 also changes (viewing mode). Thereby, the staff who operates the staff terminal 20 and the customer who browses the store terminal 30 can also browse the image inside the selected property from the viewpoint of the customer wearing the VR browsing terminal 40.

  It is also possible to change the content image from the staff terminal 20 side (customer service mode). For example, when a predetermined operation (for example, a click operation using a mouse) is performed on an icon of a specific property displayed in the property display field b11 on the connection screen B2 of the staff terminal 20, the content image of the property Data M2, M3, and M4 are transmitted from the information management server 10 to the staff terminal 20, the store terminal 30, and the VR browsing terminal 40, respectively, and a content image of the property is displayed on each terminal. Further, by performing a predetermined operation on the floor plan display field b13, the display area of the content image displayed on each terminal can be changed. The staff appropriately supports customer's property selection by operating the staff terminal 20 and interacting with the customer via video and audio while switching the content image displayed on the store terminal 30 and the VR browsing terminal 40. can do.

  Here, in the above description, by operating the consultation start button a63 displayed on the property information screen A6 (see FIG. 16) or the consultation start button a94 displayed on the browsing screen A10 (see FIG. 21), The remote consultation process was started. The remote consultation process may be started by operating the consultation start button a53 displayed on the store information screen A5 (see FIG. 15). In this case, immediately after the remote consultation process is started, the property to be browsed is not decided, so the customer may select the property while interacting with the staff. In this case, the customer service mode in which the content image displayed on the store terminal 30 and the VR browsing terminal 40 is determined by the operation on the staff terminal 20 until the property that the customer desires to see is found. In addition, after the property that the customer wants to see is decided, when the viewing mode is switched to the viewing mode in which the content image displayed on the staff terminal 20 and the store terminal 30 is determined based on the attitude information transmitted from the VR viewing terminal 40. good.

  Such switching between the customer service mode, the browsing mode, and the self mode (see steps S203, S102, and S204 in FIG. 10) may be performed from the store terminal 30 or from the staff terminal 20.

  As described above, according to the present embodiment, a business operator prepares a general-purpose computer to be used as the staff terminal 20 by registering information related to his business, a store, a product, or a service in the information management server 10. By doing so, a remote face-to-face customer service can be started. Accordingly, the business operator can acquire and expand a new customer service place without requiring a large cost burden or human burden.

  Further, according to the present embodiment, a database that can be searched from various viewpoints such as by industry, by business, by product or service category is constructed in the store management database of the information management server 10, so that the same or different industries The information management system 1 can be used simultaneously by a plurality of business operators. Accordingly, it is possible to increase the types of customer service available to customers and improve customer convenience.

  In addition, according to the present embodiment, the customer introduces the desired product (property) while consulting with the store staff in the self mode for searching for the desired product (property) using the store terminal 30. The mode can be selected and can be switched in the middle. Therefore, the customer can easily receive a service using the information management system 1 according to the purpose of use, the category of the product, his / her preference, and the like. In addition, since the store staff only needs to respond to the customer service mode when requested by the customer, it is possible to improve the efficiency of the business and avoid the excessive customer service.

  Further, according to the present embodiment, the content image related to the product or service provided by the operator is displayed three-dimensionally on the VR browsing terminal 40, so that the customer can confirm the product or service with a sense closer to reality. Can do. For example, even when a customer chooses a real estate property, it is possible to browse and evaluate many properties without going to the site. In addition, the staff of the store can save the trouble of guiding the customer to the site and can improve the efficiency of the business.

  Moreover, according to this embodiment, since the display area of the content image displayed on the staff terminal 20 and the store terminal 30 is changed based on the attitude information of the VR browsing terminal 40, the staff operating the staff terminal 20, The customer who browses the store terminal 30 can also browse the content image from the same viewpoint as the customer wearing the VR browsing terminal 40. Thereby, the staff can intuitively grasp where the customer pays attention to the product (property) and what the customer is interested in. For this reason, unlike general remote communication in which video and audio are simply transmitted and received, the staff shares the atmosphere of the place where the user can browse products and the like, and can easily grasp the implicit message issued by the customer. Thereby, the staff can respond flexibly, such as changing the description of the product etc. according to the interest of the customer. In other words, by sharing the atmosphere of the place with the customer, the staff interacts by sending and receiving video and audio, thereby providing the customer with a service that is more realistic but remote, The quality can be improved. Further, the customer who browses the store terminal 30 can communicate and select a product or service while looking at the same target as the customer wearing the VR browsing terminal 40.

  Further, according to the present embodiment, when the content image data M2, M3, and M4 to be browsed are stored in the staff terminal 20, the store terminal 30, and the VR browsing terminal 40, respectively, and the attitude of the VR browsing terminal 40 is changed. Only the posture information is transmitted from the VR browsing terminal 40. Therefore, it is possible to change the display area of the content image in each terminal almost in real time based on the attitude information without incurring communication traffic.

  In the above-described embodiment, the stereoscopic image is displayed as the content image on the VR browsing terminal 40, but a panoramic image may be displayed. In this case, two images with parallax as shown in FIG. 20 are not displayed on the display unit 42 of the VR browsing terminal 40, but an omnidirectional image (or an image taken with a wide-angle lens) is displayed. A panoramic image obtained by cutting out a part is displayed on the entire screen of the display unit 42. In this case, the display area of the panoramic image displayed on the staff terminal 20, the store terminal 30, and the VR browsing terminal 40 changes based on the posture information acquired in the VR browsing terminal 40.

  In the above embodiment, the store terminal 30 is used to perform operations such as searching for products and stores and the start of display of content images. However, the VR browsing terminal 40 may be used to perform these operations. good. In this case, by transmitting and receiving audio between the VR browsing terminal 40 and the staff terminal 20, the customer can use the VR browsing terminal 40 alone to display images of products and the like without using the store terminal 30. It is possible to display on the browsing terminal 40 and to communicate with the staff who operates the staff terminal 20 via video and audio.

  The present invention is not limited to the above embodiment, and various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above embodiment. For example, some components may be excluded from all the components shown in the above embodiment, or the components shown in the above embodiment may be combined as appropriate.

DESCRIPTION OF SYMBOLS 1 Information management system 2 Customer 3 Holder 4 Booth 4a Bench 4b Shelf 10 Information management server 11, 21, 31, 41 Communication interface 12, 26, 36, 47 Memory | storage part 13, 27, 37, 48 Processor 20 Staff terminal 20a, 20b Staff terminal 22, 32, 42 Display unit 23, 33, 43 Operation input unit 24, 34, 44 Camera 25, 35, 45 Voice input / output unit 30 Store terminal 40 VR viewing terminal 42a, 42b Area 46 Sensor unit 121, 261, 361, 471 Program storage unit 122, 262, 362, 472 Store management information storage unit 123 Content image data storage unit 131 Information search unit 132 Screen creation unit 133 Image extraction unit 134 Terminal connection unit 271 Connection reception unit 272, 372, 482 display control unit 273, 373, 483 Display switching unit 371 Connection request unit 461 Gyro sensor 462 Acceleration sensor 481 Attitude information acquisition unit DB1 Industry database DB2 Business database DB3 Store database DB4 Category database DB5 Product (service) database DB6 Device database DB7 Session database M1 Map image data M2, M3, M4 Content image data

Claims (8)

At least an information management server having a storage unit for storing a plurality of types of image data related to goods or services;
A staff terminal used by staff of an operator providing the product or service, the staff terminal connected to the information management server via a communication network,
A customer terminal used by a customer, the customer terminal connected to the information management server and the staff terminal via the communication network;
With
The information management server transmits image data related to a common product or service among the plurality of types of image data to the staff terminal and the customer terminal, respectively.
The customer terminal has a first display unit that displays an image based on image data transmitted from the information management server, and an image to be displayed on the first display unit according to the attitude of the customer terminal And changing the display area, and sending information representing the posture to the staff terminal,
The staff terminal includes a second display unit that displays an image based on the image data transmitted from the information management server, and the second terminal displays the second information according to the information indicating the attitude transmitted from the customer terminal. Changing the display area of the image displayed on the display section to the same display area as the display area of the image displayed on the first display section ,
Information management system. A second customer terminal different from the previous Ki顧 customer terminal used by the customer, the information management server via the communications network, the staff terminal, and a second customer terminals connected to the customer terminal In addition,
The information management server transmits the image data to at least the staff terminal and the customer terminal in response to an operation performed on the second customer terminal.
The information management system according to claim 1. The information management server transmits, to the second customer terminal, image data related to a product or service that is the same as the image data transmitted to the staff terminal and the customer terminal among the plurality of types of image data,
The customer terminal further transmits information representing the attitude to the second customer terminal,
The second customer terminal has a third display unit that displays an image based on the image data transmitted from the information management server, and according to the information indicating the attitude transmitted from the customer terminal, Changing a display area of an image displayed on the third display unit;
The information management system according to claim 2. The staff terminal has a camera capable of shooting a staff who operates the staff terminal, and video data generated by shooting with the camera is recorded on at least one of the customer terminal and the second customer terminal. Send in real time,
Of the customer terminal and the second customer terminal, the one that receives the video data from the staff terminal displays a video based on the video data in real time.
The information management system according to claim 2 or 3. The second customer terminal transmits a signal for switching between display and non-display of the video to the customer terminal in response to an operation performed on the second customer terminal,
The customer terminal switches between display and non-display of the video on the first display unit according to the signal.
The information management system according to claim 4. The staff terminal performs transmission and reception of voice data in real time between at least one of the customer terminal and the second customer terminal,
When the staff terminal, the customer terminal, and the second customer terminal receive voice data, the voice based on the received voice data is reproduced in real time.
The information management system according to any one of claims 2 to 5. The information management server transmits image data configured for stereoscopic viewing to the customer terminal,
The customer terminal displays a stereoscopic image on the first display unit based on the image data configured for the stereoscopic vision.
The information management system according to any one of claims 1 to 6. An information management method executed in an information management system connected to a communication network,
The information management system includes:
At least an information management server having a storage unit for storing a plurality of types of image data related to goods or services;
A staff terminal used by staff of an operator providing the product or service, the staff terminal connected to the information management server via a communication network,
A customer terminal used by a customer, the customer terminal connected to the information management server and the staff terminal via the communication network;
With
Transmitting from the information management server image data related to a common product or service among the plurality of types of image data to the staff terminal and the customer terminal, respectively;
In the customer terminal, an image based on the image data transmitted from the information management server is displayed on the first display unit of the customer terminal, and displayed on the first display unit according to the attitude of the customer terminal. Changing the display area of the image to be
Transmitting information representing the attitude from the customer terminal to the staff terminal;
In the staff terminal, an image based on the image data transmitted from the information management server is displayed on the second display unit of the staff terminal, and according to the information indicating the attitude transmitted from the customer terminal, Changing the display area of the image displayed on the second display section to the same display area as the display area of the image displayed on the first display section ;
Information management method.

Images