JP2017224229A - Facility monitoring portable terminal and facility monitoring system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a facility monitoring portable terminal which can directly display a state of a monitoring object with contents described in an instruction manual while suppressing an increase in cost of the monitoring object.SOLUTION: An electronic control device 10 emits a light emission signal temporally changing. An imaging device 21 images the electronic control device 10. An instruction manual storage section 23 stores instruction manual data in which a light emission pattern of the light emission signal is associated with description beforehand. A moving image analysis section 24 analyzes a temporal change of the light emission signal from a moving image imaged by an imaging device 21, and acquires description associated with the light emission pattern analyzed from the instruction manual data. A description display section 25 superimposes the description on an image of the electronic control device 10 during imaging, and displays the description superimposed thereon on a display device 22.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a facility monitoring portable terminal and a facility monitoring system.

  Many electronic control devices such as a programmable logic controller (PLC) and an inverter drive device are used in a plant production line. The electronic control device that is the monitoring target includes an indicator for displaying the state. Conventionally, small LEDs that emit light emission signals have been used as indicators. Conventionally, small LEDs represent several states by color, number, arrangement, lighting state, and blinking state (flicker).

  In order to understand the state of the electronic control unit, the user needs to visually check the display state of the small LED, check the display state of the small LED described in the manual, and read the explanation regarding the matched item. There is.

  In recent years, electronic control devices having a small liquid crystal panel as an indicator have appeared. By using a small liquid crystal panel, the state of the electronic control unit can be displayed directly with the contents described in the manual, and the display contents can be more detailed, sophisticated and subdivided than small LEDs. is there.

JP 2012-242914 A

  However, if a small liquid crystal panel is provided as an indicator, the price of the electronic control device increases due to an increase in the number of parts. In addition, due to the recent miniaturization of electronic control devices, it is difficult to attach a small liquid crystal panel. Further, if the small liquid crystal panel is further downsized for mounting, there is a problem that the visibility is lowered.

  Patent Document 1 proposes a technique for securing visibility by separating a small liquid crystal panel from an electronic control device in order to remove the influence of downsizing the electronic control device. However, a means for communicating with the small liquid crystal panel for the indicator is required on the electronic control device side, and the price of the electronic control device further increases.

  The present invention has been made to solve the above-described problems, and suppresses the price increase of the monitoring target and can monitor the state of the monitoring target directly with the contents described in the manual. An object is to provide a portable terminal and an equipment monitoring system.

In order to achieve the above object, an embodiment of the present invention is a facility monitoring portable terminal,
A photographing device for photographing a monitoring target that emits a light emission signal that changes over time;
A display device for displaying the monitoring target being photographed by the photographing device;
A manual storage unit that stores in advance manual data that associates a light emission pattern of the light emission signal with an explanatory note;
Analyzing a temporal change of the light emission signal from a moving image photographed by the photographing apparatus, and obtaining a description associated with the analyzed light emission pattern from the instruction data;
And an explanatory text display unit that superimposes the explanatory text on the monitoring target image being captured and displays the image on the display device.

Another embodiment of the present invention is an equipment monitoring system comprising an electronic control device and equipment monitoring portable terminal in order to achieve the above object,
The electronic control device
A state monitoring unit that monitors its own state;
A display information generation unit that outputs a light emission pattern according to the state;
A light emitting device that emits a light emission signal that changes with time according to the light emission pattern,
The facility monitoring portable terminal is:
A photographing device for photographing the electronic control device;
A display device for displaying the electronic control device being photographed by the photographing device;
A manual storage unit that stores in advance manual data that associates a light emission pattern of the light emission signal with an explanatory note;
Analyzing a temporal change of the light emission signal from a moving image photographed by the photographing apparatus, and obtaining a description associated with the analyzed light emission pattern from the instruction data;
And an explanatory text display unit that superimposes the explanatory text on the image of the electronic control device being photographed and displays it on the display device.

  According to the embodiment of the present invention, since the light emitting device is employed as the indicator to be monitored and the conventional small liquid crystal panel is not employed, an increase in the price of the subject to be monitored can be suppressed. Further, if instruction data relating to a plurality of monitoring objects is stored in one facility monitoring portable terminal, a plurality of monitoring objects can be monitored by one facility monitoring portable terminal. Therefore, the overall cost increase as the equipment monitoring system can be suppressed. Furthermore, the facility monitoring portable terminal can directly display the state of the monitoring target with the contents described in the manual based on the moving image of the monitoring target captured by the imaging device. Furthermore, by increasing the number of light emission patterns, the display content can be detailed, sophisticated, and subdivided, and the status of the monitoring target can be easily monitored.

It is a functional block diagram of the equipment monitoring system concerning Embodiment 1 of the present invention. It is a figure which shows an example of the light emission pattern produced | generated in the display information generation part. 4 is a diagram for explaining an example of a screen displayed on the display device 22. FIG. It is a flowchart of the processing routine which the equipment monitoring portable terminal 20 in Embodiment 1 performs. It is a block diagram which shows the hardware structural example of the processing circuit which the electronic control apparatus 10 has. It is a block diagram which shows the hardware structural example of the processing circuit which the equipment monitoring portable terminal 20 has. It is a functional block diagram of the equipment monitoring system concerning Embodiment 2 of the present invention. It is a flowchart of the processing routine which the equipment monitoring portable terminal 20 in Embodiment 2 performs.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, the same code | symbol is attached | subjected to the element which is common in each figure, and the overlapping description is abbreviate | omitted.

Embodiment 1 FIG.
<System configuration>
FIG. 1 is a functional block diagram of an equipment monitoring system according to Embodiment 1 of the present invention. The facility monitoring system 1 includes an electronic control device 10 and a facility monitoring portable terminal 20. Although one electronic control device 10 is illustrated in FIG. 1, the facility monitoring system 1 may include a plurality of electronic control devices 10. That is, it is possible to monitor a plurality of electronic control devices 10 with one facility monitoring portable terminal 20.

<< Electronic control device >>
The electronic control device 10 is a device to be monitored and controls an actuator arranged on a production line of a plant. The electronic control device 10 is, for example, a programmable logic controller (PLC) or an inverter driving device.

  The electronic control device 10 includes a state monitoring unit 11, a display information generation unit 12, and a light emitting device 13.

  The state monitoring unit 11 monitors the state of the electronic control device 10 itself, and outputs a state signal corresponding to the detected state.

  The display information generation unit 12 outputs a light emission pattern corresponding to the state signal output by the state monitoring unit 11. The light emission pattern is a signal obtained by combining a lighting state and a light-off state, and is a signal indicating one meaning by a temporal change between the light-on state and the light-off state. Various light emission patterns can be defined by combining a plurality of lighting states and extinguishing states and setting the time of each lighting state and the time of each extinguishing state (for example, like a Morse code signal). Therefore, advanced information can be transmitted as compared with a signal defined by an instantaneous state (color, number, arrangement, lighting state).

  FIG. 2 is a diagram illustrating an example of a light emission pattern generated in the display information generation unit 12. In the example of FIG. 2, a start code 121 that informs the start of the light emission pattern is output first. In the example of FIG. 2, the start code 121 is a signal that blinks three times at the same interval in the period from time t0 to t1. After the start code 121 is output, the light emission pattern 122 is output during a period from time t1 to time t2. After time t2, the start code 121 and the light emission pattern 122 are repeated.

  The light emitting device 13 emits a light emission signal that changes over time according to the light emission pattern output by the display information generation unit 12. The light emitting device 13 is a lamp, for example, a small LED.

<< Facilities monitoring portable terminal >>
The equipment monitoring portable terminal 20 is a portable terminal for monitoring the state of one or a plurality of electronic control devices 10, and is, for example, a tablet or a wearable smart glass.

  The equipment monitoring portable terminal 20 includes a photographing device 21, a display device 22, a manual storage unit 23, a moving image analysis unit 24, an explanatory text display unit 25, and a logging unit 28.

  The photographing device 21 photographs the electronic control device 10 that emits a light emission signal that changes with time. The photographing device 21 is a camera capable of photographing a moving image.

  The display device 22 includes a display (for example, a small liquid crystal panel), and displays an image of the electronic control device 10 being photographed by the photographing device 21 in real time. In addition, the display device 22 displays the explanatory text output from the explanatory text display unit 25 so as to be superimposed on the image of the electronic control device 10 being photographed.

  The instruction storage unit 23 stores in advance instruction data in which the light emission pattern of the light emission signal is associated with the explanatory text. The instruction storage unit 23 is a database that stores instruction data in which a light emission pattern of a light emission signal emitted from the light emitting device 13 and a description thereof are associated with each other on a one-to-one basis.

  The moving image analysis unit 24 first analyzes the temporal change of the light emission signal from the moving image captured by the imaging device 21. Next, the moving image analysis unit 24 collates the analyzed light emission pattern with the light emission pattern stored in the instruction storage unit 23. When the light emission patterns match, the moving image analysis unit 24 acquires an explanatory text associated with the analyzed light emission pattern from the manual data.

  The explanatory note display unit 25 superimposes an explanatory note on the image of the electronic control device 10 being photographed and displays it on the display device 22. The display position of the explanatory text may be a predetermined position on the screen of the display device 22 or the periphery of the light emitting device 13 displayed on the screen.

  The logging unit 28 acquires a moving image and its explanatory text from the moving image analysis unit 24 and associates them with each other as monitoring log information. The logging unit 28 stores the monitoring log information in the storage 208 of FIG.

  FIG. 3 is a diagram for explaining an example of a screen displayed on the display device 22. The display device 22 has a screen 30. On the screen 30, an image of the electronic control device 10 (light emitting device 13) being photographed by the photographing device 21 is displayed in real time. The explanatory text output by the explanatory text display unit 25 is displayed in the explanatory column 31 on the screen 30. When the explanatory note display unit 25 outputs the coordinates of the display position in addition to the explanatory note, the explanatory column 31 can be displayed at an arbitrary position on the screen 30. In this way, by superimposing and displaying the explanatory text on the image of the electronic control device 10 being photographed (overlay display), it becomes possible to monitor the equipment using the augmented reality expression.

<Flowchart>
FIG. 4 is a flowchart of a processing routine executed by the facility monitoring portable terminal 20 in the first embodiment in order to realize the above-described operation. The user starts photographing of the electronic control device 10 (light emitting device 13) using the equipment monitoring portable terminal 20.

  In the routine shown in FIG. 4, first, in step S100, the moving image analysis unit 24 determines whether or not a start code is detected. Specifically, the moving image analysis unit 24 analyzes temporal changes in the light emission signal emitted from the light emitting device 13 from the moving image captured by the image capturing device 21. The moving image data is acquired from the imaging device 21 at regular intervals or in real time. If the moving image includes a start code, the determination condition is satisfied, and the process proceeds to step S110. On the other hand, if the moving image does not include a start code, the determination condition is not satisfied, and a new moving image is acquired and the determination process of step S100 is executed again.

  In step S110, the moving image analysis unit 24 analyzes temporal changes in the light emission signal from the start code to the next start code. The light emission pattern of the light emission signal during this period indicates the state of the electronic control device 10. The moving image analysis unit 24 collates the analyzed light emission pattern with the light emission pattern stored in the instruction storage unit 23.

  Next, in step S120, the moving image analysis unit 24 acquires an explanatory text associated with the analyzed light emission pattern from the manual data.

  Next, in step S130, the display device 22 superimposes and displays the explanatory text output from the explanatory text display unit 25 on the image of the electronic control device 10 being imaged by the imaging device 21 (FIG. 3). Thereafter, this routine is terminated.

<Effect>
As described above, according to the system in the first embodiment, the light emitting device 13 is employed as the indicator of the electronic control device 10 and the conventional small liquid crystal panel is not employed. Can be suppressed. In addition, if one piece of equipment monitoring portable terminal 20 stores instruction data related to a plurality of electronic control devices 10, one piece of equipment monitoring portable terminal 20 can monitor a plurality of electronic control devices 10. Therefore, the overall cost increase as the equipment monitoring system 1 can be suppressed. Furthermore, the equipment monitoring portable terminal 20 can directly display the state of the electronic control device 10 with the contents described in the manual based on the moving image of the electronic control device 10 photographed by the photographing device 21.

  Furthermore, by increasing the number of light emission patterns, the display content can be detailed, sophisticated, and subdivided, and the status of the electronic control device 10 can be easily monitored. In addition, in order to increase the light emission pattern, it is only necessary to add the data of the display information generation unit 12, and it is not necessary to add a physical device.

  Furthermore, since the explanatory text can be displayed superimposed on the image of the electronic control device 10 during shooting, an expression using augmented reality (AR) that can be easily perceived by the user can be realized. Furthermore, by using a moving image obtained by photographing the light emitting device 13 with the photographing device 21, the equipment monitoring portable terminal 20 can monitor the electronic control device 10 without being connected to the electronic control device 10 through a computer network.

<Modification>
By the way, in the system of the first embodiment described above, the start code is output before the light emission pattern that means the state of the electronic control device 10 to identify the start timing of the light emission pattern. There is no need. This point is the same in the following embodiments.

<Hardware configuration example>
The hardware configuration of the electronic control device 10 and the equipment monitoring portable terminal 20 will be described with reference to FIGS. 5 and 6. The same applies to the second embodiment.

  FIG. 5 is a block diagram illustrating a hardware configuration example of a processing circuit included in the electronic control device 10. Each unit in the electronic control device 10 indicates a part of the function of the device, and each function is realized by a processing circuit. For example, the processing circuit includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an input / output interface 104, a system bus 105, an input device 106, a display device 107, a storage 108, and The computer includes a communication device 109.

  The CPU 101 is a processing device that executes various types of arithmetic processing using programs and data stored in the ROM 102 and the RAM 103. The ROM 102 is a read-only storage device that stores a basic program, an environment file, and the like for causing a computer to realize each function. A RAM 103 is a main storage device that stores a program executed by the CPU 101 and data necessary for the execution of each program, and can be read and written at high speed. The input / output interface 104 is a device that mediates connections between various hardware and the system bus 105. A system bus 105 is an information transmission path shared by the CPU 101, ROM 102, RAM 103, and input / output interface 104.

  The input / output interface 104 is connected to hardware such as an input device 106, a display device 107, a storage 108, and a communication device 109. The input device 106 is a device that processes input from a user, and is, for example, an operation panel. The display device 107 is a device that displays the state of the electronic control device 10, and is the light emitting device 13 or the liquid crystal panel described above. The storage 108 is a large-capacity auxiliary storage device that stores programs and data, and is, for example, a hard disk device or a nonvolatile semiconductor memory. The communication device 109 is a device capable of data communication with an external actuator or sensor by wire or wireless.

  FIG. 6 is a block diagram illustrating a hardware configuration example of a processing circuit included in the equipment monitoring portable terminal 20. Each part in the equipment monitoring portable terminal 20 indicates a part of the function of the terminal, and each function is realized by a processing circuit. For example, the processing circuit is a computer including a CPU 201, a ROM 202, a RAM 203, an input / output interface 204, a system bus 205, an input device 206, a display device 207, a storage 208, a communication device 209, and a photographing device 210.

  The configuration shown in FIG. 6 is different in program, data, processing capability, etc., but the basic functions as a computer are the same as the configuration shown in FIG. Therefore, descriptions of the CPU 201, ROM 202, RAM 203, and storage 208 are omitted. The input / output interface 204 is connected to hardware such as an input device 206, a display device 207, and a photographing device 210. The input device 206 is, for example, an operation button or a touch panel operated by a user. The display device 207 includes the display device 22 described above. The communication device 209 is a device for acquiring manual data from outside by wire or wireless. The imaging device 210 includes the imaging device 21 described above.

Embodiment 2. FIG.
<System configuration>
Next, a second embodiment of the present invention will be described with reference to FIGS. In the system of the present embodiment, in the configuration shown in FIG. 7, the routine of FIG. 8 is executed before the execution of the routine of FIG.

  In the first embodiment described above, the facility monitoring portable terminal 20 uses the instruction data stored in advance in the instruction storage unit 23. By the way, when the electronic control device 10 is modified (when a light emission pattern is added) or when the number of electronic control devices 10 to be monitored increases, it is necessary to update the instruction data.

  Therefore, in the equipment monitoring system 1 according to the second embodiment, the contents of the instruction data are easily updated and executed uniformly for the plurality of equipment monitoring portable terminals 20.

  FIG. 7 is a functional block diagram of the equipment monitoring system according to Embodiment 2 of the present invention. The equipment monitoring system 1 shown in FIG. 7 has the same configuration as that shown in FIG. 1 except that the equipment monitoring portable terminal 20 further includes a manual updating unit 26. In FIG. 7, the same components as those shown in FIG. 1 are denoted by the same reference numerals, and the description thereof is omitted or simplified.

  The instruction updating unit 26 is connected to the external server 27 via the computer network using the communication device 209 (FIG. 6). The instruction updating unit 26 downloads the latest instruction data from the external server 27 and stores it in the instruction storage unit 23. The external server 27 may be an in-house server connected via a LAN or a cloud server connected via the Internet.

  In addition, the logging unit 28 according to the second embodiment acquires a moving image and an explanation thereof from the moving image analysis unit 24 and associates them with each other as monitoring log information. The logging unit 28 uploads the monitoring log information to the external server 27 described later. Thereby, the monitoring log information obtained by the plurality of facility monitoring portable terminals 20 is centrally managed by the external server 27.

<Flowchart>
FIG. 8 is a flowchart of a processing routine executed by the facility monitoring portable terminal 20 according to the second embodiment. The routine of FIG. 8 is executed before the routine of FIG. 4 is executed, for example, when the equipment monitoring portable terminal 20 is activated.

  In step S200, the instruction updating unit 26 inquires of the external server 27 about the latest instruction data version.

  In step S210, the instruction updating unit 26 compares the version of the instruction data inquired to the external server 27 with the version of the instruction data stored in the instruction storage unit 23, and needs to be downloaded. It is determined whether or not. If the determination condition is satisfied, the process proceeds to step S220. If the determination condition is not satisfied, the process of this routine is terminated.

  Next, in step S <b> 220, the instruction updating unit 26 downloads the latest instruction data from the external server 27.

  Next, in step S <b> 230, the manual update unit 26 stores the latest downloaded manual data in the manual storage unit 23. Thereafter, the processing of this routine is terminated. After this routine, the routine of FIG. 4 is executed.

<Effect>
As described above, according to the system in the second embodiment, the contents of the manual data can be updated easily and uniformly for the plurality of facility monitoring portable terminals 20. Then, the routine of FIG. 4 can be executed using the latest manual data.

DESCRIPTION OF SYMBOLS 1 Equipment monitoring system 10 Electronic control apparatus 11 State monitoring part 12 Display information production | generation part 13 Light-emitting device 20 Equipment monitoring portable terminal 21 Imaging device 22 Display apparatus 23 Manual storage part 24 Moving image analysis part 25 Description sentence display part 26 Manual update Unit 27 External server 28 Logging unit 30 Screen 31 Description column 101, 201 CPU
102, 202 ROM
103, 203 RAM
104, 204 Input / output interface 105, 205 System bus 106, 206 Input device 107, 207 Display device 108, 208 Storage 109, 209 Communication device 210 Imaging device

Claims (6)

A photographing device for photographing a monitoring target that emits a light emission signal that changes over time;
A display device for displaying the monitoring target being photographed by the photographing device;
A manual storage unit that stores in advance manual data that associates a light emission pattern of the light emission signal with an explanatory note;
Analyzing a temporal change of the light emission signal from a moving image photographed by the photographing apparatus, and obtaining a description associated with the analyzed light emission pattern from the instruction data;
An explanatory text display unit that overlays the explanatory text on the monitoring target image being photographed and displays the image on the display device;
A facility monitoring portable terminal comprising: Further comprising a manual updating unit that downloads the manual data from an external server and stores it in the manual storage unit;
The equipment monitoring portable terminal according to claim 1. A logging unit that uploads monitoring log information that associates the moving image and the explanatory text to the external server;
The equipment monitoring portable terminal according to claim 2. A facility monitoring system comprising an electronic control device and a facility monitoring portable terminal,
The electronic control device
A state monitoring unit that monitors its own state;
A display information generation unit that outputs a light emission pattern according to the state;
A light emitting device that emits a light emission signal that changes with time according to the light emission pattern,
The facility monitoring portable terminal is:
A photographing device for photographing the electronic control device;
A display device for displaying the electronic control device being photographed by the photographing device;
A manual storage unit that stores in advance manual data that associates a light emission pattern of the light emission signal with an explanatory note;
Analyzing a temporal change of the light emission signal from a moving image photographed by the photographing apparatus, and obtaining a description associated with the analyzed light emission pattern from the instruction data;
An explanatory text display unit that superimposes the explanatory text on the image of the electronic control device being photographed and displays it on the display device,
Equipment monitoring system characterized by The facility monitoring portable terminal further includes a manual update unit that downloads the manual data from an external server and stores the data in the manual storage unit,
The equipment monitoring system according to claim 4. The facility monitoring portable terminal further includes a logging unit that uploads monitoring log information that associates the moving image and the explanatory text to the external server,
The equipment monitoring system according to claim 5.

Images