JP2010145301A - Measurement visualizing system and head mounted display - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a measurement visualizing system and a head mounted display capable of easily estimating the arrangement position of a sensor node and visualizing the collection results while suppressing amount of communication data. <P>SOLUTION: After starting a timer for monitoring a fixed period (S31), it is determined by a sensor node which constitutes sensor network whether the transfer data involving measurement values is received or not (S39) in a state where the period is un-coming(S33:NO). When the transfer data is received (S39:YES), sensor ID, number of relaying times, and measurement value information involved in the transfer data are stored in a flash memory (S40, S43). On the contrary, when the period is coming (S33:YES), the arranged position of the sensor node is specified based on the received number of relaying times, and the specified arrangement position and the measurement value information are displayed to an observer who mounts a head mounted display to be visualized (S36). <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a measurement visualization system and a head mounted display. More specifically, the present invention relates to a measurement visualization system capable of specifying the arrangement state of sensor nodes constituting a sensor network by a simple method and visualizing it together with measurement values, and a head mounted display.

  Conventionally, so-called sensor networks in which sensor nodes (sensors and devices having at least a wireless function) are distributed over a wide range, and measured values (temperature, humidity, atmospheric pressure, images, etc.) are communicated wirelessly between the nodes. Is attracting attention. The sensor network makes it possible to acquire in real time the status and information of various things such as places, people, things, and environments that could not be grasped until now. Thereby, it becomes possible to grasp in real time human flow, environmental information, disaster information, crime prevention information, and facility / facility information.

In the sensor network, it is necessary to grasp various measurement values measured by the sensor node in association with the arrangement position. Here, when the position of the sensor node is unknown, the position is calculated by calculating the distance to the sensor node based on a method of recognizing the position of the moving object from the electric field strength of the radio wave (see Patent Document 1). Thus, it is possible to estimate the arrangement position of the sensor node.
JP 2008-124995 A

  However, the above-described method has a problem that a separate means for measuring the electric field strength is required at the sensor node. In addition, the communication distance of each sensor node is short, and usually the measured value is transferred from one sensor node to another sensor node one after another, and this is repeated to transmit the measured value to the target terminal. For this reason, the problem is that wireless radio waves reach the terminal directly and the sensor nodes that can measure the distance are only a part of the sensor network, and most of the sensor nodes do not receive the radio radio waves directly, so the location cannot be specified. There is a point.

  The present invention has been made to solve the above-described problems, and does not require a means for measuring the electric field strength, and is capable of estimating the arrangement position of the sensor node and visualizing the collection result. And a head-mounted display.

  In order to solve the above-described problems, the measurement visualization system according to the first aspect of the present invention collects the measurement results measured by the sensor nodes constituting the sensor network on the head mounted display, thereby obtaining the collection result. A measurement visualization system for visualizing, wherein the sensor node is a measurement unit that measures a predetermined physical quantity, and data that is transmitted to the head mounted display, and includes a measurement value measured by the measurement unit. Sensor transmission means for transmitting transfer data that is data including at least measurement value information that is information and relay count information that is relay count information when the data is relayed and transferred between the sensor nodes; Sensor receiving means for receiving the transfer data transmitted from the sensor node, and received by the sensor receiving means. Relay update that updates the relay count information included in the received transfer data when the transfer data is relay-transferred to the head mounted display by transmitting the transfer data by the sensor transmission means And the head mounted display includes display receiving means for receiving the transfer data transmitted by the sensor transmitting means, and the measurement value information included in the transfer data received by the display receiving means. Associated with the distance between the sensor node and the head-mounted display based on the storage count information stored in the storage means It is specified by the distance index specifying means for specifying the sensor distance index as an index and the measurement value information. Display means for displaying on the display means the measured value and the sensor distance index specified by the distance index specifying means based on the relay count information associated with the measurement value information. Yes.

  Further, in the measurement visualization system according to the second aspect of the invention, in addition to the configuration of the invention according to the first aspect, the distance index specifying means sets a predetermined value to the number of relays specified by the relay number information. The multiplied value is used as the sensor distance index.

  Further, in the measurement visualization system of the invention according to claim 3, in addition to the configuration of the invention of claim 1 or 2, the head mounted display displays the number of the measurement value information stored in the storage means, Based on the cumulative means for accumulating for each of the relay times specified in the relay frequency information, and the distribution tendency of the cumulative number that is the number of the measurement value information accumulated by the cumulative means for each of the relay times An arrangement state specifying unit for specifying the arrangement state of the sensor node, and the display control unit displays the specified arrangement state when the arrangement state is specified by the arrangement state specifying unit. It is characterized by being displayed on the means.

  In addition to the configuration of the invention according to claim 3, the measurement visualization system of the invention according to claim 4 is characterized in that the arrangement state specifying means includes the cumulative number corresponding to the first relay count that is the predetermined relay count. The first cumulative number that is a number is compared with the second cumulative number that is the number of relays that is greater than the first relay number and that corresponds to the second relay number that is the predetermined relay number. As a result of comparing the cumulative number by the cumulative number comparison means and the cumulative number comparison means, the sensor node surrounds the head mounted display when the first cumulative number is equal to or greater than the second cumulative number. When the first cumulative number is smaller than the second cumulative number, the sensor node is arranged in a specific direction of the head mounted display. Judgment And a relative configuration determining means that.

  A head-mounted display according to a fifth aspect of the invention is a head-mounted display that collects measurement values measured by sensor nodes constituting a sensor network and visualizes the collected results, and is transmitted from the sensor node. Measurement value information that is measurement value information measured by the sensor node and relay count information that is relay count information when the data is relayed and transferred between the sensor nodes. Display receiving means for receiving transfer data that is at least data included, and storage for storing the measured value information and the relay count information included in the transfer data received by the display receiving means in association with each other in the storage means Based on the control means and the relay frequency information stored in the storage means, the sensor node and the head. A distance index specifying means for specifying a sensor distance index that is a distance index to the mount display; the measurement value specified by the measurement value information; and the relay count information associated with the measurement value information. Display control means for displaying on the display means the sensor distance index specified by the distance index specifying means.

  According to a sixth aspect of the present invention, in addition to the configuration of the fifth aspect of the invention, the distance index specifying unit sets a predetermined value to the number of relays specified by the relay number information. The multiplied value is determined as the sensor distance index.

  According to a seventh aspect of the present invention, in addition to the configuration of the fifth or sixth aspect, the number of the measurement value information stored in the storage means is determined by the relay count information. An arrangement of the sensor nodes based on a cumulative means for accumulating for each specified number of relays, and a distribution tendency of the cumulative number, which is the number of the measurement value information accumulated by the cumulative means, for each number of relay times Arrangement state specifying means for specifying the state.

  According to an eighth aspect of the present invention, in addition to the configuration of the seventh aspect of the invention, the arrangement state specifying means includes the cumulative number corresponding to the first relay count that is the predetermined relay count. The first cumulative number that is a number is compared with the second cumulative number that is the number of relays that is greater than the first relay number and that corresponds to the second relay number that is the predetermined relay number. As a result of comparing the cumulative number by the cumulative number comparison means and the cumulative number comparison means, the sensor node surrounds the head mounted display when the first cumulative number is equal to or greater than the second cumulative number. When the first cumulative number is smaller than the second cumulative number, the sensor node is arranged in a specific direction of the head mounted display. And a relative configuration determining means for determining that.

  In the measurement visualization system according to the first aspect, the transfer data relayed and transferred between the sensor nodes is collected by the head mounted display. Then, based on the number of relay transfers included in the transfer data, a distance index indicating how far from the head mounted display to the sensor node is determined. Then, the collected measurement values and the identified distance index are displayed on the display means. This makes it possible for the user of the head mounted display to visually recognize the video in a state where the collected measurement values are associated with the distance index from the head mounted display.

  In the measurement visualization system according to the second aspect of the present invention, the head mounted display can easily estimate the distance to the sensor node without performing complicated control such as distance measurement. Thereby, in addition to the effect of the invention described in claim 1, the collected measurement values and the distance to the sensor node can be visually recognized by the user of the head mounted display.

  In the measurement visualization system according to the third aspect of the invention, the head mounted display can recognize the arrangement state of the sensor nodes arranged in the surroundings. Thereby, in addition to the effect of the invention described in claim 1 or 2, it is possible to make the user of the head mounted display visually recognize the collected measurement value and the video showing the arrangement state of the sensor node.

  In the measurement visualization system according to the fourth aspect of the invention, it is possible to estimate the arrangement state of sensor nodes according to the state of the cumulative number of sensor nodes around the head mounted display. Thus, in addition to the effect of the invention described in claim 3, it is possible to make the user of the head mounted display visually recognize an image showing the measured value measured by the sensor node and the arrangement state of the sensor node.

  In the head mounted display according to the fifth aspect, the transfer data relayed and transferred between the sensor nodes is received. Then, a distance index from the head mounted display to the sensor node is determined based on the number of relay transfers included in the transfer data. Thereby, it is possible to make the user visually recognize an image showing the collected measurement values and the determined distance index.

  Further, in the head mounted display according to the sixth aspect of the invention, in addition to the effect of the invention according to the fifth aspect, the distance index to the sensor node can be easily calculated without performing complicated control such as distance measurement. It becomes possible. As a result, the user can visually recognize the collected measurement values and the video indicating the distance index to the sensor node.

  In addition, in the head mounted display of the invention according to claim 7, in addition to the effect of the invention of claim 5 or 6, it is possible to recognize the state of the arrangement distribution of the sensor nodes arranged around the head. Become. Thereby, it becomes possible for the user to visually recognize the collected measurement values and the video showing the arrangement state of the sensor nodes.

  In the head mounted display according to the eighth aspect of the invention, in addition to the effect of the invention according to the seventh aspect, the arrangement state of the sensor nodes is changed according to the cumulative number of sensor nodes around the head mounted display. It becomes possible to identify visually. Thereby, it becomes possible for the user to visually recognize an image showing the measured value measured by the sensor node and the arrangement state of the sensor node.

  Embodiments of a measurement visualization system and a head mounted display according to the present invention will be described below with reference to the drawings. These drawings are used for explaining the technical features that can be adopted by the present invention, and the configuration of the apparatus described, the flowcharts of various processes, etc., unless otherwise specified. It is not intended to be limited to that, but merely an illustrative example.

  An overview of the measurement visualization system 1 will be described with reference to FIG. FIG. 1 is a schematic diagram showing an outline of the measurement visualization system 1.

  As shown in FIG. 1, the measurement visualization system 1 includes a plurality of sensor nodes 6 (601 to 605 and the like) and a head mounted display 2. The sensor node 6 has a measurement function and a wireless communication function. The sensor node 6 constitutes a so-called sensor network capable of collecting information on measured values (hereinafter referred to as “measured value information”) by wireless communication. In the measurement visualization system 1, measurement value information is collected by the head mounted display 2. The collected measurement value information is displayed to the observer 3 together with information on the arrangement position of the sensor node 6. Thereby, the observer 3 can recognize the visualized measurement value information and the arrangement position of the sensor. The physical quantity measured by the sensor node 6 is not particularly limited, and examples thereof include temperature, humidity, pressure, and the like.

  The communication system between the individual sensor nodes 6 will be outlined. When a predetermined physical quantity is measured by the sensor node 6, the measured value information is transmitted to the head mounted display 2 by radio. Here, when the distance between the head mounted display 2 and the sensor node 6 is long and the sensor node 6 cannot directly communicate with the head mounted display 2, the measurement value information can be communicated. The data is relayed between adjacent sensor nodes 6 and collected on the head mounted display 2. Specifically, as shown in FIG. 1, when a physical quantity is measured by a sensor node 601, communication data including measurement value information (hereinafter referred to as “transfer data”) is another sensor that can communicate with adjacent sensors. Wirelessly transmitted to a node (for example, sensor node 602). Next, the sensor node 602 that has received the transfer data wirelessly transmits the received transfer data to another adjacent sensor node (for example, the sensor node 603) that can communicate. By repeating this (sensor node 604, sensor node 605), the transfer data is relayed and transferred to the head mounted display 2. Through the communication as described above, the head mounted display 2 can collect measurement value information.

  The communication method of the present invention is not limited to a specific relay transfer method, and various conventionally known wireless relay transfer methods can be used. Therefore, in addition to the above communication method (flooding method), a routing method in which relay transmission is performed by specifying the relay destination sensor node 6 and transmitting transfer data can be used.

  In the measurement visualization system 1 of the present invention, the communication between the sensor nodes 6 is performed wirelessly. However, the present invention is not limited to this, and the configuration may be such that communication is performed via a wire.

  A method for displaying measured value information on the head mounted display 2 will be outlined. When the transfer data is received, the head mounted display 2 acquires the number of times of transfer of the transfer data (the number of times of relay transfer by the sensor node 6) together with the measurement value information. The number of relays is included in the transfer data in advance and is updated when relayed and transferred by the sensor node 6 (details will be described later). In the head mounted display 2, it is estimated as a distance index indicating how far the head mounted display 2 and the sensor node 6 are based on the acquired number of relays. That is, it is estimated that the greater the number of relays, the farther away the sensor node 6 is, and the farther the distance is. Then, the estimated distance index is displayed on the head mounted display 2 together with the received measurement value information. As a result, it is possible to cause the user wearing the head mounted display 2 to visually recognize the video indicating the measurement value information measured by the sensor node 6 and the arrangement state of the sensor node 6.

  A schematic configuration of the head mounted display 2 will be described with reference to FIG. FIG. 2 is a diagram showing an external configuration of the head mounted display 2.

  As shown in FIG. 2, the head mounted display 2 scans and emits laser light modulated in accordance with an image signal (hereinafter referred to as “image light 4”), and the retina of at least one eye of the observer 3. Project an image directly on Thereby, the observer 3 is made to visually recognize an image. As shown in FIG. 2, the head mounted display 2 emits image light 4 according to an image signal, guides the image light 4 emitted from the emission device 100, and observes the image light 4. It includes at least a prism 151 that reflects toward the eyes of the person 3 and a support member 200 that supports the emission device 100 and the prism 151.

  The emission device 100 causes the image light 4 to be emitted to the prism 151. The prism 151 is in a fixed position with respect to the emission device 100, guides the image light 4 emitted from the emission device 100, and reflects the image light 4 toward the eyes of the observer 3. The prism 151 includes a beam splitter (not shown), transmits the external light 5 from the outside, and guides it to the eyes of the observer 3. The prism 151 causes the image light 4 incident from the side of the observer 3 to enter the eye of the observer 3 and causes the external light 5 from the outside to enter the eye of the observer 3. Thereby, not only an actual field of view but also an image based on the image light 4 emitted from the emission device 100 can be visually recognized.

  In the present embodiment, the prism 151 is configured so that the external light 5 and the image light 4 can be viewed simultaneously. However, the present invention is not limited to this configuration, and for example, a half mirror can be used instead of the prism 151. As a result, the image light 4 from the emitting device 100 can be reflected by the half mirror and incident on the eyes of the observer 3, and the external light 5 can be transmitted through the half mirror and incident on the eyes of the observer 3. Become.

  In this embodiment, a see-through head mounted display using retinal scanning is described as an example of the head mounted display. However, the present invention is not limited to this example. For example, a head using a reflective LCD It may be a mount display.

  The electrical configuration of the head mounted display 2 will be described with reference to FIG. FIG. 3 is a schematic diagram showing an electrical configuration of the head mounted display 2.

  As shown in FIG. 3, the head mounted display 2 performs wireless communication with the display unit 40 for allowing the observer 3 to visually recognize an image, the input unit 41 for performing various operations and data input, and the sensor node 6 to transmit the transfer data. Controls the short-range wireless communication unit 43 for receiving, the flash memory 49 in which information of received transfer data, image data such as images (graphics) displayed on the display unit 40, and the like, and the entire head mounted display 2 are controlled. A control unit 46 and a power supply unit 47 are provided.

  The display unit 40 receives video information (hereinafter referred to as “video information”) to be viewed by the observer 3 from the control unit 46 and converts the information into signals necessary for direct projection onto the retina of the observer 3. A video signal processing unit 70, a laser group 72 for outputting laser light (a blue output laser (B laser) 721, a green output laser (G laser) 722, a red output laser (R laser) 723), and a laser group A laser driver group 71 that performs control for outputting laser light from 72 is provided. The video signal processing unit 70 is electrically connected to the laser driver group 71 so that a desired laser beam can be output at a desired timing under the control of the video signal processing unit 70. The laser driver group 71 is electrically connected to the B laser 721, the G laser 722, and the R laser 723, respectively. Further, the video signal processing unit 70 and the control unit 46 are electrically connected via a bus so that the video signal processing unit 70 can receive a video signal from the control unit 46.

  The display unit 40 is output from the laser group 72, a galvano mirror 812 that performs scanning by reflecting the laser beam output from the laser group 72 in the vertical direction, a vertical scanning control circuit 811 that controls driving of the galvano mirror 812, and the laser group 72. A galvano mirror 792 that performs scanning by reflecting laser light in the horizontal direction and a horizontal scanning control circuit 791 that controls driving of the galvano mirror 792 are provided. The video signal processing unit 70, the vertical scanning control circuit 811, and the horizontal scanning control circuit 791 are electrically connected so that the laser light can be reflected in a desired direction by the control of the video signal processing unit 70. It is connected to the. The vertical scanning control circuit 811 is electrically connected to the galvanometer mirror 812. The horizontal scanning control circuit 791 is electrically connected to the galvanometer mirror 792.

  The display unit 40 drives the wavefront curvature modulation unit 78 and the wavefront curvature modulation unit 78 for modulating the wavefront curvature (spreading degree) of the laser beam in order to adjust the depth of the image visually recognized by the observer 3. A curvature driving circuit 83 is provided. The video signal processing unit 70 is electrically connected to the wavefront curvature driving circuit 83 so that the video signal processing unit 70 can modulate the laser light with a desired modulation degree. The wavefront curvature drive circuit 83 is electrically connected to the wavefront curvature modulation unit 78.

  The input unit 41 includes an operation button group 50 including various function keys and the like, and an input control circuit 51 that detects that a key of the operation button group 50 is operated and notifies the control unit 46 of the operation. The operation button group 50 is electrically connected to the input control circuit 51 so that the information input to the keys of the operation button group 50 can be recognized by the control unit 46. The input control circuit 51 is electrically connected to the control unit 46.

  The short-range wireless communication unit 43 controls the short-range wireless communication module 57 that transmits and receives radio waves to and from the sensor node 6 and the short-range wireless communication control that controls the short-range wireless communication module 57 and receives transfer data. Circuit 58. The control unit 46 and the short-range wireless communication control circuit 58 are electrically connected via a bus so that the transfer data can be acquired by the control unit 46. The short-range wireless communication module 57 is electrically connected to the short-range wireless communication control circuit 58.

  The communication method of the short-range wireless communication module 57 is not particularly limited as long as it can communicate with the sensor node 6, and a conventionally known wireless communication method can be used. For example, a wireless communication system compliant with Zigbee (registered trademark), Bluetooth (registered trademark), UWB (Ultra Wide Band) standards, wireless LAN (IEEE802.11b, etc.) standards, WirelessUSB standards, or the like can be used. In addition, a wireless communication system based on IrDA (Infrared Data Association) standard using infrared rays can be used.

  The power supply unit 47 supplies a battery 59 serving as a power source for driving the head mounted display 2 and power of the battery 59 to the head mounted display 2 and also supplies power supplied from a charging adapter (not shown). A charge control circuit 60 that supplies the battery 59 to charge the battery 59 is provided.

  The flash memory 49 is electrically connected to the control unit 46 via a bus so that the information stored in the storage area can be referred to by the control unit 46. Details of the information stored in the flash memory 49 will be described later.

  The control unit 46 has a function of controlling the entire head mounted display 2. For example, based on information included in the transfer data received from the sensor node 6 via the short-range wireless communication unit 43, the sensor arrangement is arranged. Performs processing to specify the state. Further, for example, the display unit 40 is controlled so that the observer 3 can visually recognize a desired video. The control unit 46 includes a CPU 61, a ROM 62 that stores various programs, a RAM 48 that temporarily stores various data, and the like. In the control unit 46, the CPU 61 reads out various programs stored in the ROM 62, thereby executing each process. The RAM 48 stores various flags, counters, and the like that are necessary when the CPU 61 executes each process.

  The outline of the process of forming the image light 4 on the display unit 40 will be described in detail with reference to FIG. FIG. 4 is a schematic diagram showing an electrical and optical configuration of the display unit 40. As shown in FIG. 4, the display unit 40 includes a light source unit 65, a wavefront curvature modulator 78, a horizontal scanning system 79, a first relay optical system 80, a vertical scanning system 81, and a second relay optical system 82. . The light source unit 65 includes a video signal processing unit 70, a laser driver group 71, a laser group 72, a collimating optical system 73, a dichroic mirror group 74, a coupling optical system 75, and a wavefront curvature driving circuit 83. The wavefront curvature modulator 78 includes a wavefront curvature modulator 781, a fixed focus lens 782, and a variable focus lens 783. The horizontal scanning system 79 includes a horizontal scanning control circuit 791 and a galvanometer mirror 792. The vertical scanning system 81 includes a vertical scanning control circuit 811 and a galvanometer mirror 812.

  The configuration of the light source unit 65 will be described in detail. The video signal processing unit 70 is electrically connected to the control unit 46 as described above. Then, video information created by the CPU 61 in order to project desired information onto the retina via the control unit 46 is input. A luminance signal 66 (B luminance signal 661, G luminance signal 662, R luminance signal 663), vertical synchronizing signal 67, horizontal synchronizing signal 68, and depth signal 84 are electrically connected to the video signal processing unit 70, respectively. Yes. In the video signal processing unit 70, each signal (luminance signal, horizontal synchronization signal, vertical synchronization signal, depth signal) which is an element for projecting the input video information onto the retina is generated. Each of the generated signals is output for each pixel with respect to the luminance signal 66, the horizontal synchronization signal 68, the vertical synchronization signal 67, and the depth signal 84.

  The luminance signal 66 (B luminance signal 661, G luminance signal 662, R luminance signal 663) is electrically connected to the laser driver group 71 (B laser driver 711, G laser driver 712, R laser driver 713). Yes. The horizontal synchronization signal 68 is connected to the horizontal scanning control circuit 791 of the horizontal scanning system 79. The vertical synchronization signal 67 is connected to the vertical scanning control circuit 811 of the vertical scanning system 81. The depth signal 84 is connected to the wavefront curvature drive circuit 83.

  The laser driver group 71 is electrically connected to the laser group 72 (B laser 721, G laser 722, R laser 723), respectively. The laser driver group 71 applies laser light that has been intensity-modulated based on each luminance signal of each signal transmitted via the luminance signal 66 (B luminance signal 661, G luminance signal 662, R luminance signal 663). In order to emit light from 72, the laser group 72 is driven.

  A collimating optical system 73 (731 to 733) capable of collimating three colors (blue, green, and red) of laser light emitted from the laser group 72 under the control of the laser driver group 71 into parallel light; A dichroic mirror group 74 (741 to 743) capable of combining the laser light collimated at 73 and a coupling optical system 75 for guiding the combined laser light to the optical fiber 76 are provided.

  As the laser group 72 (B laser 721, G laser 722, R laser 723), a semiconductor laser such as a laser diode or a solid-state laser may be used.

  The configuration of the display unit 40 excluding the light source unit 65 will be described in detail. The laser light guided from the light source unit 65 to the optical fiber 76 is guided to the fixed focus lens 782 of the wavefront curvature modulation unit 78. The laser light emitted from the fixed focus lens 782 is guided to the variable focus lens 783.

  The operation principle of the wavefront curvature modulator 78 will be outlined. In a state where the focal length of the variable focal length lens 783 and the focal length of the fixed focal length lens 782 are the same distance, the laser light that has passed through the variable focal length lens 783 is the main point of the variable focal length lens 783 and the fixed focal length lens 782. Since the focal point is set in the middle of the principal point, the laser light passing through the variable focus lens 783 is collimated to parallel light. On the other hand, in a state where the focal length of the variable focal length lens 783 and the focal length of the fixed focal length lens 782 are different, the laser light passing through the variable focal length lens 783 is not collimated to the parallel light and diffuses with a spread of a predetermined angle. To do. Depending on the degree of diffusion, the apparent light emission point can be moved back and forth. In this way, the wavefront curvature modulation unit 78 adjusts the depth of the image visually recognized by the observer 3 by changing the wavefront curvature (the degree of spread) of the laser light.

  The wavefront curvature modulator 781 has a function of adjusting the focal length of the variable focus lens 783 and is electrically connected to the wavefront curvature drive circuit 83 via a drive signal 69. The wavefront curvature modulator 781 is driven based on the drive signal 69 output from the wavefront curvature drive circuit 83. In the wavefront curvature drive circuit 83, a signal for driving the wavefront curvature modulator 781 is generated based on the depth signal 84 generated and output from the video signal processing unit 70. The generated signal is output to the wavefront curvature modulator 781 to drive the wavefront curvature modulator 781.

  A galvanometer mirror 792 is provided for scanning the laser beam that has passed through the variable focus lens 783 in the horizontal direction. The laser light incident on the deflection surface 793 of the galvanometer mirror 792 is scanned in the horizontal direction in synchronization with the horizontal synchronization signal received from the horizontal synchronization signal 68 under the control of the horizontal scanning control circuit 791. The horizontal scanning system 79 of the present embodiment is an optical system for horizontally scanning the laser beam in the horizontal direction (an example of primary scanning) for each scanning line of an image to be displayed.

  A first relay optical system 80 for guiding the horizontally scanned laser light to the vertical scanning system 81 is provided. In addition, a galvanometer mirror 812 is provided for causing the laser light guided by the first relay optical system 80 to scan in the vertical direction. The laser light incident on the deflection surface 813 of the galvanometer mirror 812 is scanned in the vertical direction in synchronization with the vertical synchronization signal received from the vertical synchronization signal 67 under the control of the vertical scanning control circuit 811. The vertical scanning system 81 of this embodiment is an optical system that vertically scans a laser beam vertically from the first scanning line to the last scanning line (an example of secondary scanning) for each frame of an image to be displayed. It is.

  A second relay optical system 82 for guiding the vertically scanned laser light (image light 4) to the prism 151 is provided. The image light 4 guided by the second relay optical system 82 enters the prism 151. The prism 151 is disposed between the second relay optical system 82 and the pupil 90 of the observer 3. The prism 151 guides the image light 4 to the pupil 90 of the observer 3 by totally reflecting the image light 4 or the like.

  In the display unit 40 described above, the horizontal scanning system 79 is designed to scan the laser beam at a higher speed, that is, at a higher frequency than the vertical scanning system 81. The first relay optical system 80 is provided so that the galvanometer mirror 792 of the horizontal scanning system 79 and the galvanometer mirror 812 of the vertical scanning system 81 are conjugate. The second relay optical system 82 is provided so that the galvanometer mirror 812 and the pupil 90 of the user are conjugate.

  A process from when the head-mounted display 2 according to the embodiment of the present invention receives an image signal from the outside until it projects an image on the retina of the user will be described with reference to FIG.

  In the head mounted display 2 of the present embodiment, the video signal processing unit 70 provided in the light source unit 65 receives the video signal. Next, a luminance signal 66 comprising a B luminance signal 661, a G luminance signal 662, and an R luminance signal 663 for outputting laser beams of red, green, and blue colors from the video signal processing unit 70, a horizontal synchronizing signal 68, and a vertical synchronizing signal. A signal 67 and a depth signal 84 are output.

  The B laser driver 711, the G laser driver 712, and the R laser driver 713 are respectively applied to the B laser 721, the G laser 722, and the R laser 723 based on the input B luminance signal 661, G luminance signal 662, and R luminance signal 663. Output each drive signal.

  Based on the drive signal described above, the B laser 721, the G laser 722, and the R laser 723 each generate intensity-modulated laser light. The generated laser light is output to the collimating optical system 73. Each of the laser beams is collimated into parallel light by the collimating optical system 73, and further, is incident on the dichroic mirror group 74 to be combined into one laser beam. The combined laser beam is guided to enter the optical fiber 76 by the coupling optical system 75.

  The laser light transmitted through the optical fiber 76 is guided to the fixed focus lens 782. Then, the light is emitted to the variable focus lens 783. The focus of the variable focus lens 783 is changed by the control of the wavefront curvature drive circuit 83 and the wavefront curvature modulator 781. The laser light that has passed through the variable focus lens 783 is emitted to the horizontal scanning system 79.

  The laser light incident on the horizontal scanning system 79 is scanned in the horizontal direction in synchronization with the horizontal synchronization signal 68 on the deflection surface 793 of the galvanometer mirror 792. The galvanometer mirror 792 is reciprocally oscillated in synchronization with the horizontal synchronizing signal 68 so that the deflecting surface 793 reflects incident light in the horizontal direction. The galvano mirror 792 scans the laser beam in the horizontal direction. The horizontally scanned laser light is emitted to the vertical scanning system 81 via the first relay optical system 80.

  In the first relay optical system 80, the deflection surface 793 of the galvanometer mirror 792 and the deflection surface 813 of the galvanometer mirror 812 are adjusted to have a conjugate relationship, and the surface tilt of the galvanometer mirror 792 is corrected.

  The laser light incident on the vertical scanning system 81 is scanned in the vertical direction in synchronization with the vertical synchronization signal 67 on the deflection surface 813 of the galvanometer mirror 812. The galvanometer mirror 812 is reciprocally oscillated so that the deflection surface 813 reflects incident light in the vertical direction in synchronization with the vertical synchronization signal 67 in the same manner as the galvanometer mirror 792 is synchronized with the horizontal synchronization signal 68. . Laser light is scanned in the vertical direction by the galvanometer mirror 812.

  The laser light (image light 4) scanned two-dimensionally in the vertical and horizontal directions by the horizontal scanning system 79 and the vertical scanning system 81 has a conjugate relationship between the deflection surface 813 of the galvano mirror 812 and the pupil 90 of the user. The light is incident on the user's pupil 90 by the second relay optical system 82 and the prism 151, and projected onto the retina.

  Through the process described above, the observer 3 can recognize an image by the laser light that is two-dimensionally scanned and projected onto the retina. The galvanometer mirror 792 of the horizontal scanning system 79 and the galvanometer mirror 812 of the vertical scanning system 81 have the same names, but their reflecting surfaces are swung (rotated) so as to scan light. It goes without saying that any drive system such as a resonance type, non-resonance type, piezoelectric drive, electromagnetic drive, electrostatic drive, or the like may be used.

  The information stored in the flash memory 49 of the head mounted display 2 will be described with reference to FIG. FIG. 5 is a schematic diagram showing a storage area of the flash memory 49 of the head mounted display 2. As shown in FIG. 5, the flash memory 49 is provided with a first storage area 491, a second storage area 492, and other areas. The first storage area 491 stores a table (reception data table) in which the measurement value information received from the sensor node 6 is associated with the number of relays and information (sensor ID) for specifying the sensor node 6. . In the second storage area 492, an image (first display mode 110, second display mode 120, see FIGS. 12 and 13, details will be described later) to be viewed by the observer 3 via the display unit 40 of the head mounted display 2. Information is stored.

  Details of the reception data table stored in the first storage area 491 will be described with reference to FIG. FIG. 6 is a schematic diagram showing a reception data table. In the reception data table, information included in the transfer data received from the sensor node 6 is stored. The received data table shown in FIG. 6 includes information items of sensor ID, number of relays, and measurement value information.

  The sensor ID stores the ID of the sensor node that is the source of the transfer data. The number of relays stores the number of relays included in the transfer data transmitted from the sensor node 6 specified by the ID. The measured value information stores a physical quantity measured by the sensor of the sensor node 6 specified by the ID. In the example shown in FIG. 6, the transfer data transmitted from the sensor node with ID: 1 has reached the head mounted display 2 by being relayed and transferred five times, and the measured value is “0.05”. . Further, the transfer data transmitted from the sensor node of ID: 2 has reached the head mounted display 2 by being relay-transferred once, and the measured value is “1.2”.

  The electrical configuration of the sensor node 6 will be described with reference to FIG. FIG. 7 is a schematic diagram showing an electrical configuration of the sensor node 6. As shown in FIG. 7, the sensor node 6 includes a CPU 101 that controls communication control, measurement control, and the like, a ROM 102 that stores each control program and parameters executed by the CPU 101, a flag and a timer that are used when the CPU 101 performs processing, and the like. Is stored. The CPU 101, the ROM 102, and the RAM 103 are electrically connected to each other via a bus so that the CPU 101 can access the storage areas of the ROM 102 and the RAM 103.

  The sensor node 6 includes a sensor 104 that can measure a predetermined physical quantity as a measurement value. The CPU 101 and the sensor 104 are electrically connected to each other via a bus so that the CPU 101 can recognize the measurement value measured by the sensor 104.

  The sensor node 6 includes a wireless communication module 105 capable of performing wireless communication. The wireless communication module 105 can modulate the data received from the CPU 101 by a predetermined modulation method and transmit the radio wave via an antenna not shown. In addition, it is possible to demodulate radio wave signals received via an antenna (not shown) and transfer the demodulated data to the CPU 101. The CPU 101 and the wireless communication module 105 are electrically connected via a bus.

  The transfer data transmission / reception process executed by the CPU 101 of the sensor node 6 will be described with reference to FIG. FIG. 8 is a flowchart of transfer data transmission / reception processing executed by the CPU 101 of the sensor node 6. The transfer data transmission / reception process is activated and executed by the CPU 101 when the sensor node 6 is powered on.

  As shown in FIG. 8, when the power of the sensor node 6 is turned on, first, a process of updating the timer stored in the RAM 103 at a constant cycle is started (S11). Thereby, monitoring of elapsed time is started.

  Next, it is determined whether a predetermined time has elapsed since the start of monitoring the elapsed time (S13). If it is determined that the timer value has reached a predetermined value and the predetermined time has elapsed (S13: YES), the measured value is acquired from the sensor 104 (S15). Then, transfer data including the acquired measurement value information (measurement value information), its own ID, and the number of relays ("0" is stored) is created. The created transfer data is wirelessly transmitted via the wireless communication module 105 (S17). Next, the monitoring timer is reset (S19). And it returns to S13 and the above-mentioned process is repeatedly performed.

  If it is determined that the timer value is not the predetermined value and the predetermined time has not elapsed (S13: NO), whether transfer data is received from another sensor node 6 via the wireless communication module 105 It is judged (S20). If the transfer data has not been received (S20: NO), the process returns to S13 without performing any special process, and the above process is repeatedly executed.

  When transfer data is received from another sensor node 6 (S20: YES), first, “1” is added to the number of relays included in the received transfer data and updated (S21). Next, it is determined whether the updated number of relays is equal to or greater than a predetermined value (S23). If the number of relays is equal to or greater than the predetermined value (S23: YES), it is determined that there is no need to perform relay transmission, so the process returns to S13 without performing any special processing, and the above processing is repeated. .

  If the number of relays is less than the predetermined value (S23: NO), the transfer data with the updated number of relays is wirelessly transmitted via the wireless communication module 105 (S25). And it returns to S13 and the above-mentioned process is repeatedly performed.

  By executing the processing described above, the sensor node 6 periodically acquires a measurement value measured by the sensor 104. The transfer data including the measurement value information is wirelessly transmitted. Further, when transfer data is received from another sensor node 6, the number of relays included in the data is updated, and relay transfer is performed by wireless transmission again. Here, if the updated number of relays is equal to or greater than a predetermined value, the relay transfer is stopped. This prevents the transfer data from staying in the sensor network for a long time.

  Various processes executed by the CPU 61 of the head mounted display 2 will be described with reference to FIGS. 9 and 10. FIG. 9 is a flowchart of the main process. FIG. 10 is a flowchart of the display data creation process. The main process is started and executed by the CPU 61 when the power of the head mounted display 2 is turned on.

  The main process will be described with reference to FIG. When the power of the head mounted display 2 is turned on, a process of updating the timer stored in the RAM 48 at a constant cycle is started (S31). Thereby, monitoring of elapsed time is started.

  Next, it is determined whether a predetermined time has elapsed since the monitoring of the elapsed time was started (S33). When it is determined that the timer value is not the predetermined value and the predetermined time has not elapsed (S33: NO), it is determined whether the transfer data transmitted from the sensor node 6 has been received (S39). . When not receiving (S39: NO), it returns to S33, without performing a special process, and the above-mentioned process is repeatedly performed.

  When the transfer data is received from the sensor node 6 (S39: YES), the sensor ID, the number of relays, and the measurement value information included in the transfer data are extracted. These pieces of extracted information are stored in the reception data table stored in the first storage area 491. The reception data table stored in the first storage area 491 is referred to, and the same sensor ID as the sensor ID (hereinafter referred to as “reception sensor ID”) included in the transfer data is stored in the reception data table. In this case, the measurement value information included in the received transfer data is overwritten on the measurement value information associated with the same sensor ID as the reception sensor ID among the measurement value information stored in the reception data table. (S40).

  Next, the number of relays included in the received transfer data is compared with the number of relays associated with the same sensor ID as the reception sensor ID in the reception data table (S41). When the number of relays included in the transfer data is smaller than the number of relays associated with the same sensor ID as the reception sensor ID in the reception data table (S41: YES), the reception sensor ID in the reception data table The number of relays included in the transfer data is overwritten and stored in the number of relays associated with the same sensor ID (S43). Then, returning to the process of S33, the above-described process is repeatedly executed. On the other hand, if the transfer data associated with the same sensor ID as the reception sensor ID is larger in the reception data table (S41: NO), the process returns to S33 without performing any special processing, and the above processing is repeated. Executed.

  On the other hand, if it is determined that the timer value has reached the predetermined value and the predetermined time has elapsed (S33: YES), a display image for displaying the information stored in the reception data table on the head mounted display 2 is created. Processing (display data creation processing, see FIG. 10) is executed (S35).

  The display data creation process will be described with reference to FIG. As shown in FIG. 10, in the display data creation process, first, the reception data table is referred to. The total number of stored sensor IDs is calculated for each relay count (the calculated number is hereinafter referred to as “total number”). As a result, the total number of sensor nodes 6 is calculated for each relay count (S51). Next, the cumulative number corresponding to the smallest number of relays stored in the received data table (hereinafter referred to as “first cumulative number”) is specified. The identified first cumulative number is stored in the variable M1 (S53). Next, the total number of relays (hereinafter referred to as “second cumulative number”) corresponding to the number of relays close to a value corresponding to 3/4 of the maximum number of relays, for example, greater than ½ of the maximum number of relays. Identified. The specified second cumulative number is stored in the variable M2 (S55). Next, the variable M1 and the variable M2 are compared (S57).

  With reference to FIG. 11, the relationship between the cumulative number for each relay count and the number of sensor nodes 6 will be described. FIG. 11 is a schematic diagram illustrating the relationship between the number of relays and the number of sensor nodes for each number of relays. As shown in FIG. 11, when the sensor nodes 6 are arranged so as to surround the head mounted display 2, the number of sensor nodes shows a distribution tendency shown in (A). (A) shows a tendency that the number of sensor nodes rapidly decreases as the number of relays increases. On the other hand, when the sensor nodes 6 are densely arranged in a specific direction with respect to the head mounted display 2, the distribution tendency shown in (B) is shown. (B) shows a tendency that the number of sensor nodes gradually decreases as the number of relays increases. In the present invention, the distribution trend of the sensor node 6 is determined by simply determining the distribution trend.

  When (k × M1), which is k times the variable M1, becomes equal to or greater than the variable M2 (S57: YES), it is determined that the sensor node 6 is arranged so as to surround the head mounted display 2. Here, k is selected such that, for example, k = 0.7 if M2 is a half value of the maximum number of relays, and k = 0.5 if the value is 3/4 of the maximum number of relays. Since the cumulative number varies to some extent, k gives a margin for the effect of the variation. This makes it possible to make a determination that does not depend on fluctuations. In this case, among the display modes stored in the second storage area 492 of the flash memory 49, the first display mode 110 (see FIG. 12) is selected (S59). Then, the process proceeds to S61. On the other hand, when (k × M1) is smaller than M2 (S57: NO), it is determined that the sensor nodes 6 are densely arranged in a specific direction with respect to the head mounted display 2. In this case, the second display mode 120 (see FIG. 13) is selected from the display modes stored in the second storage area 492 of the flash memory 49 (S65). Then, the process proceeds to S61.

  When (k × M1) is equal to or greater than the variable M2, it is determined that the number of distributions of the sensor nodes 6 decreases as the distance from the head mounted display 2 increases. In the case where the head mounted display 2 is arranged at substantially the center of the distributed sensor nodes 6, the number of distribution of the sensor nodes 6 rapidly decreases when the distance from the head mounted display 2 exceeds a predetermined value. To do. Therefore, when such a distribution tendency ((k × M1) ≧ M2) is shown, it is determined that the sensor node 6 is arranged so as to surround the head mounted display 2.

  On the other hand, when (k × M1) is smaller than the variable M2, it is determined that the number of distributions of the sensor nodes 6 is substantially constant regardless of the distance from the head mounted display 2. For example, when the head mounted display 2 is arranged so as to be in contact with a large wall and the distribution of the sensor nodes 6 is densely arranged in a specific direction (a direction without a wall), the distribution of the sensor nodes 6 is a distance. It is almost constant without depending on. Therefore, when such a distribution tendency ((k × M1) <M2) is shown, it is determined that the sensor nodes 6 are densely arranged in a specific direction with respect to the head mounted display 2.

  The first display mode 110 and the second display mode 120 will be described with reference to FIGS. 12 and 13. FIG. 12 is a schematic diagram showing the first display mode 110. FIG. 13 is a schematic diagram showing the second display mode 120. The first display mode 110 shows a state in which the sensor node 6 is arranged so as to surround the head mounted display 2. The second display mode 120 shows a state in which the sensor nodes 6 are densely arranged in a specific direction with respect to the head mounted display 2.

  The first display mode 110 will be described with reference to FIG. As shown in FIG. 12, the first display mode 110 has a shape in which five circles having different radii are arranged concentrically. The first circle 111, the second circle 112, the third circle 113, the fourth circle 114, and the fifth circle 115 are arranged in ascending order of the radius. The first circle 111 corresponds to measurement value information whose number of relays is zero. Hereinafter, the second circle 112 corresponds to the number of times of relaying, the third circle 113 corresponds to the number of times of relaying 2, the fourth circle 114 corresponds to the number of times of relaying 3, and the fifth circle 115 corresponds to the information of the number of times of relaying 4 times. . The color of each circle is determined based on the measurement value information (details will be described later). In the first display mode 110, a state in which the head mounted display 2 is arranged at the center of the circle and the sensor node 6 is arranged so as to cover the periphery thereof is schematically shown. That is, it indicates that the head-mounted display 2 is in the center of the area where the physical quantity is detected by the sensor network.

  In the first display mode 110, a straight arrow 116 extending outward from the center of the circle is drawn. An arrow 116 is for indicating an index of each distance of the first circle 111 to the fifth circle 115. In the example shown in FIG. 12, one scale indicates 1 m.

  The second display mode 120 will be described with reference to FIG. As shown in FIG. 13, the second display mode 120 has a configuration in which five semicircles having different radii are concentric and have a diameter superimposed on the same line. A first circle 121, a second circle 122, a third circle 123, a fourth circle 124, and a fifth circle 125 are arranged in ascending order of radius. The first circle 121 corresponds to the measurement value information whose number of relays is zero. Hereinafter, the second circle 122 corresponds to the number of times of relaying, the third circle 123 corresponds to the number of times of relaying, the fourth circle 124 corresponds to the number of times of relaying 3, and the fifth circle 125 corresponds to the information of the number of times of relaying 4 times. . The color of each circle is determined based on the measurement value information (details will be described later). In the second display mode 120, a state in which the head mounted display 2 is arranged at the center of the circle and the sensor nodes 6 are densely arranged in a specific direction is schematically shown. That is, it indicates that the head mounted display 2 is located at the end of the region where the physical quantity is detected by the sensor network.

  In the second display mode 120, as in the first display mode 110, a linear arrow 126 extending outward from the center of the circle is drawn. An arrow 126 is for indicating an index of each distance of the first circle 121 to the fifth circle 125. In the example shown in FIG. 13, one scale indicates 1 m.

  As shown in FIG. 10, after the display mode is selected, in S61, the reception data table stored in the first storage area 491 of the flash memory 49 is referred to, and the average value of the measurement value information is determined for each relay count. Calculated (S61). The calculated average value is assigned to each circle constituting the display mode (the first display mode 110 and the second display mode 120) for each relay count. The calculated average value includes a color corresponding to a predetermined average value (for example, average value 0: blue, average value 1-5: green, average value 6-10: yellow, average value 11-15). : Red). As a result, the color of each circle constituting the selected display mode (first display mode 110 or second display mode 120) is determined (S63). When it is desired to detect an abnormality, the maximum value or the minimum value of the measurement value information may be selected for each relay count instead of the average value, and a corresponding color may be assigned.

  Next, an average value A (for example, 3 m) of a distance between adjacent sensor nodes is multiplied by a value obtained by adding 1 to each relay count. The calculated value is the distance from the head mounted display 2 to the sensor node 6 (hereinafter referred to as “sensor node distance”) (S64). For example, “(0 + 1) × A (m) = A (m)” when the number of relays is 0, “(1 + 1) × A (m) = 2A (m)” when the number of relays is 1, In the case of two times, the sensor node distance is calculated as “(2 + 1) × A (m) = 3A (m)”. Then, based on the calculated sensor node distance, the scale interval of the arrows (116, 126) in the display mode specified in S59, S65, and S61 described above is specified. Then, the display data creation process is terminated, and the process returns to the main process.

  When the sensor node 6 is temporarily installed in the disaster place or the activity is performed in a place where the position of the sensor node 6 cannot be obtained, the position of the sensor node 6 is unknown, and the distance calculated above is an accurate distance. Rather, it is an indicator of distance. If the sensor nodes 6 are arranged on the straight line at equal intervals, an accurate distance can be obtained by multiplying the number of relays by the distance between the sensor nodes. Actually, the sensor nodes 6 are not necessarily installed at equal intervals, and are rarely arranged on a straight line. Depending on the communication situation, relaying is not always performed using the shortest route, and relaying may occur by detour. However, in general, it can be said that the sensor node 6 is farther away as the number of relays is larger. Therefore, when the position of the sensor node 6 is unknown, a distance index indicating how far away from the sensor node 6 is based on the number of relays. It is very useful for the user to grasp the sense of distance to the sensor node 6.

  As A, since the distance between the sensor nodes 6 is not necessarily the same, an average value thereof can be used. Alternatively, the communicable distance of the radio signal may be set as A. In addition, since the probability of being bypassed and relayed increases as the number of relays increases, a distance index that can gradually decrease the value of A as the number of relays increases can be obtained.

  By calculating as described above, it is possible to indicate a distance index indicating whether the sensor node 6 showing the value of interest is near or away. Furthermore, if the average distance between the sensor nodes 6 is assumed, it can be estimated how far away the distance is. A may be stored in the memory in advance, or may be input from the operation unit by the user depending on the situation.

  If it is only necessary to know the sense of perspective without regard to the distance itself, the distance indicator is defined as A obtained by dividing the maximum displayable length when displaying on the head mounted display 2 by (the maximum number of relays + 1). What should I do?

  As shown in FIG. 9, in the main process after the display data creation process (S35) is completed, the display mode (color is colored and the scale interval between the arrows is specified) determined in the display data creation process. Control for making the observer 3 visually recognize the aspect (the first display aspect 110 or the second display aspect 120) is performed (S36), and the monitoring of the elapsed time started in S31 is reset and newly performed. Elapsed time monitoring is started (S37), and the process returns to S33, and the above-described process is repeatedly executed.

  With reference to FIG. 14, the image | video visually recognized by the observer 3 via the head mounted display 2 is demonstrated. FIG. 14 is a schematic diagram illustrating an example of an image visually recognized by the observer 3 through the head mounted display 2.

  As shown in FIG. 14, the first display mode 110 is displayed on the left side of the visual field on the head mounted display 2. In addition, since the see-through type head-mounted display 2 is assumed in the present embodiment, a surrounding image directly visible to the observer 3 is also displayed.

  In the example shown in FIG. 14, the first display mode 110 is displayed. The observer 3 who visually recognizes the image can recognize that the sensor node 6 is arranged so as to cover the periphery of the head mounted display 2. Further, by visually recognizing the color of the first circle 111 in the first display mode 110, it becomes possible to recognize the measurement value measured by the sensor node 6 arranged closest to the observer 3. Similarly, by visually recognizing the colors of the second circle 112, the third circle 113, the fourth circle 114, and the fifth circle 115, it is possible to recognize the measured value of the sensor node 6 for each distance from the observer 3. It becomes. In addition, the display of the arrow 116 makes it possible to specifically estimate and recognize the distance between the observer 3 and each sensor node 6.

  As described above, in the present embodiment, the observer 3 wearing the head mounted display 2 can display the measurement value measured by the sensor node 6 together with the information on the arrangement position so that the observer 3 can visually recognize it. Become. The head mounted display 2 is located at a distance from the head mounted display 2 based on the result of multiplying the number of relays of transfer data transmitted from the sensor node 6 by a predetermined value (communication distance A). Determine if it is placed. Thereby, it is possible to easily estimate the distance to the sensor node 6 without performing complicated control such as distance measurement.

  In addition, the cumulative number of transfer data for each relay count is calculated, and the arrangement state of the sensor nodes 6 is specified based on the distribution tendency. Specifically, whether the sensor nodes 6 are arranged so as to cover the periphery of the head mounted display 2 or are densely arranged in a specific direction is specified according to the calculated cumulative number tendency. Thereby, it becomes possible to display and recognize how the sensor nodes 6 are distributed to the observer 3 wearing the head mounted display 2.

  The CPU 101 that performs the process of S15 in FIG. 8 corresponds to the “measurement unit” of the present invention, the CPU 101 that performs the processes of S17 and S25 corresponds to the “sensor transmission unit” of the present invention, and the CPU 101 that performs the process of S20 The CPU 101 that performs the process of S21 corresponds to the “relay update unit” of the present invention.

  The CPU 61 that performs the process of S39 in FIG. 9 corresponds to the “display receiving unit” of the present invention, and the CPU 61 that performs the process of S43 corresponds to the “storage control unit” of the present invention, and the first storage area 491 of the flash memory 49. Corresponds to the “storage means” of the present invention. The CPU 61 that performs the process of S64 in FIG. 10 corresponds to the “distance specifying means” of the present invention. The CPU 61 that performs the process of S36 in FIG. 9 corresponds to the “display control unit” of the present invention, and the display unit 40 in FIG. 4 corresponds to the “display unit” of the present invention.

  The CPU 61 that performs the processing of S51 and S53 in FIG. 10 corresponds to the “cumulative unit” of the present invention, and the CPU 61 that performs the processing of S59 or S65 based on the result of S57 corresponds to the “arrangement state specifying unit” of the present invention. . The CPU 61 that performs the process of S57 in FIG. 10 corresponds to the “cumulative number comparison means” of the present invention, and the CPU 61 that performs the process of determining either S59 or S65 based on the result of S57 This corresponds to “placement determining means”.

  In addition, this invention is not limited to the said embodiment, A various change is possible. In the above-described embodiment, the display modes as shown in FIGS. 12 and 13 are specified and displayed to the observer 3, but the present invention is not limited to this method.

  With reference to FIG. 15, the display mode 137 in the modification will be described. FIG. 15 is a schematic diagram showing the display mode 137. As shown in FIG. 15, in the display mode 137, five circles having different radii (the first circle 131, the second circle 132, the third circle 133, the fourth circle 134, and the fifth circle 135 in order of increasing radius) are displayed. It is the state which overlapped concentrically, and has become a state which lacked a part of circle | round | yen by the line segment 136 extended in a direction parallel to a diameter. Further, the distance between the center of the circle and the line segment 136 is changed according to the relationship between M1 and M2. As a result, the distribution state of the sensor node 6 can be expressed in more detail and recognized by the observer 3.

  Since the first circle to the fifth circle in FIGS. 12 and 13 are respectively associated with the distance between the head mounted display 2 and the sensor node 6, they are not displayed in a plane, but are wavefront curvatures. You may display in three dimensions by controlling the modulation | alteration part 78. FIG. With reference to FIG.16 and FIG.17, the display mode in the case of displaying in three dimensions is demonstrated. FIG. 16 is a schematic diagram showing a display mode 140 when the sensor node 6 is three-dimensionally displayed in a state where the sensor node 6 is arranged so as to surround the head mounted display 2. FIG. 17 is a schematic diagram showing a display mode 160 when the sensor nodes 6 are densely arranged in a specific direction with respect to the head mounted display 2.

  With reference to FIG. 16, a display mode 140 in the case where the sensor node 6 is displayed in a three-dimensional manner so as to surround the head mounted display 2 will be described. As shown in FIG. 16, the display mode 140 has a shape in which isosceles triangles are equally divided into 10 in the vertical direction. In the divided areas (areas 141 to 150 in order from the left), the areas 145 and 146 have 0 relays, the areas 144 and 147 have 1 relays, the areas 143 and 148 have 2 relays, and the areas 142 and 149 relay. The number of times is 3, and the areas 141 and 150 correspond to measurement information of the number of relay times of 4, respectively. Each color is determined based on the measurement value information. The center of the sensor node group is defined as regions 145 and 146, which are represented by triangles that become lower toward both ends. The area of each region may schematically indicate the cumulative number of sensor nodes 6 having the same number of relays.

  Further, by controlling the wavefront curvature modulator 781 to drive the variable focus lens 783, the region 145 and the region 146 are arranged closest to the observer 3, and the region 144 → the region 142 and the region 147 → the region 149 are extended. The region 141 and the region 150 are disposed farthest away so that they are visually recognized. In this case, control may be performed so that the display area is sequentially switched from the near area to the far area for each display frame. Thereby, the observer 3 can visually recognize the display mode 140 in a state where the actual sense of distance is reproduced.

  With reference to FIG. 17, a display mode 160 when the sensor nodes 6 are densely arranged in a specific direction with respect to the head mounted display 2 will be described. As shown in FIG. 17, in the display mode 160, a right triangle has a shape divided into five equal parts in the vertical direction (the right angle portion is arranged on the left side). As for the divided areas (areas 161 to 165 in order from the right), the area 161 has 0 relays, the area 162 has 1 relays, the area 163 has 2 relays, the area 164 has 3 relays, and the area 165 relays Each corresponds to the measurement information of 4 times. Each color is determined based on the measurement value information. The area of each region may schematically indicate the cumulative number of sensor nodes 6 having the same number of relays.

  Similarly to the display mode 140, by controlling the wavefront curvature modulator 781 and driving the variable focus lens 783, the region 161 is arranged closest to the observer 3, and gradually distant from the region 162 to the region 164. And the region 165 is arranged farthest to be visually recognized. Thereby, the observer 3 can visually recognize the display mode 160 in a state where the actual sense of distance is reproduced.

1 is a schematic diagram showing an outline of a measurement visualization system 1. FIG. FIG. 2 is a diagram illustrating an external configuration of a head mounted display 2. 3 is a schematic diagram showing an electrical configuration of a head mounted display 2. FIG. 3 is a schematic diagram showing an electrical and optical configuration of a display unit 40. FIG. 3 is a schematic diagram showing a storage area of a flash memory 49 of the head mounted display 2. FIG. It is a schematic diagram which shows a reception data table. 3 is a schematic diagram showing an electrical configuration of a sensor node 6. FIG. It is a flowchart of a transfer data transmission / reception process. It is a flowchart of a main process. It is a subroutine flowchart of a display data creation process. It is a schematic diagram which shows the relationship between the total number for every relay frequency, and the number of sensor nodes. 4 is a schematic diagram showing a first display mode 110. FIG. 6 is a schematic diagram showing a second display mode 120. FIG. 4 is a schematic diagram showing an example of an image visually recognized by an observer 3 through a head mounted display 2. FIG. It is a schematic diagram which shows the display mode 137. FIG. It is a schematic diagram which shows the display mode. 6 is a schematic diagram showing a display mode 160. FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Measurement visualization system 2 Head mounted display 3 Observer 6, 601, 602, 603, 604, 605 Sensor node 40 Display part 43 Near field communication part 46 Control part 49 Flash memory 491 First storage area 492 Second storage area 61 CPU
101 CPU
104 sensor 105 wireless communication module

Claims (8)

A measurement visualization system that visualizes collection results by collecting measurement values measured by sensor nodes constituting a sensor network on a head-mounted display,
The sensor node is
A measuring means for measuring a predetermined physical quantity;
The data transmitted to the head mounted display, the measured value information which is information of the measured value measured by the measuring means, and the number of relays when the data is relayed and transferred between the sensor nodes Sensor transmission means for transmitting transfer data which is data including at least relay number information which is information of
Sensor receiving means for receiving the transfer data transmitted from the other sensor nodes;
Included in the received transfer data when the transfer data is relayed to the head mounted display by transmitting the transfer data received by the sensor receiving means by the sensor transmitting means. Relay update means for updating the relay count information,
The head mounted display is
Display receiving means for receiving the transfer data transmitted by the sensor transmitting means;
Storage control means for storing the measured value information and the relay count information included in the transfer data received by the display receiving means in association with each other in storage means;
Distance index specifying means for specifying a sensor distance index, which is an index related to the distance between the sensor node and the head mounted display, based on the relay count information stored in the storage means;
The measurement value identified by the measurement value information and the sensor distance index identified by the distance index identification means based on the relay count information associated with the measurement value information are displayed on a display means. And a measurement visualization system including display control means. The distance index specifying means includes
The measurement visualization system according to claim 1, wherein a value obtained by multiplying the relay count specified by the relay count information by a predetermined value is used as the sensor distance index. The head mounted display is
Accumulating means for accumulating the number of the measured value information stored in the storage means for each number of times of relay specified by the number of times of relay;
An arrangement state specifying unit that specifies an arrangement state of the sensor node based on a distribution tendency of the cumulative number, which is the number of the measurement value information accumulated by the accumulation unit, for each relay count; Means
The measurement visualization system according to claim 1, wherein when the arrangement state is specified by the arrangement state specifying unit, the specified arrangement state is displayed on the display unit. The arrangement state specifying means includes
The first cumulative number corresponding to the first relay count corresponding to the predetermined relay count, and the second relay count that is the relay count greater than the first relay count and the predetermined relay count. A cumulative number comparing means for comparing the cumulative number corresponding to the second cumulative number;
As a result of comparing the cumulative number by the cumulative number comparison means, the sensor node is arranged so as to surround the head mounted display when the first cumulative number is equal to or greater than the second cumulative number. And determining that the sensor node is positioned in a specific direction of the head mounted display when the first cumulative number is smaller than the second cumulative number. The measurement visualization system according to claim 3, further comprising: means. A head-mounted display that collects measurement values measured by sensor nodes constituting a sensor network and visualizes the collection results,
It is data transmitted from the sensor node, which is measurement value information that is information of measurement values measured by the sensor node, and information on the number of relays when the data is relayed and transferred between the sensor nodes. Display receiving means for receiving transfer data that is data including at least certain relay count information;
Storage control means for storing the measured value information and the relay count information included in the transfer data received by the display receiving means in a storage means in association with each other;
Distance index specifying means for specifying a sensor distance index, which is a distance index between the sensor node and the head mounted display, based on the relay count information stored in the storage means;
The measurement value specified by the measurement value information and the sensor distance index specified by the distance index specification means based on the relay count information associated with the measurement value information are displayed on a display means. A head-mounted display comprising display control means. The distance index specifying means includes
6. The head mounted display according to claim 5, wherein a value obtained by multiplying the relay count specified by the relay count information by a predetermined value is determined as the sensor distance index. Accumulating means for accumulating the number of the measured value information stored in the storage means for each number of times of relay specified by the number of times of relay;
An arrangement state specifying unit that specifies an arrangement state of the sensor node based on a distribution tendency of the cumulative number, which is the number of the measurement value information accumulated by the accumulation unit, for each relay count. The head-mounted display according to claim 5 or 6, The arrangement state specifying means includes
The first cumulative number corresponding to the first relay count corresponding to the predetermined relay count, and the second relay count that is the relay count greater than the first relay count and the predetermined relay count. A cumulative number comparing means for comparing the cumulative number corresponding to the second cumulative number;
As a result of comparing the cumulative number by the cumulative number comparison means, the sensor node is arranged so as to surround the head mounted display when the first cumulative number is equal to or greater than the second cumulative number. And determining that the sensor node is positioned in a specific direction of the head mounted display when the first cumulative number is smaller than the second cumulative number. The head mounted display according to claim 7, further comprising: means.

Images