JP7197314B2 - Work machine display system and its control method - Google Patents

Description

The present invention relates to work machines.

A work machine such as a wheel loader has a bucket rotatable in a dumping direction at the tip of a boom rotatable in the vertical direction. By operating the operation device, the operator rotates the bucket in the dumping direction and makes it substantially horizontal, and then drives the working machine to perform excavation work in which the bucket penetrates a pile of earth and sand. This loads the cargo into the bucket. The operator turns the boom or the vehicle body so that the work machine faces the transport machine such as a dump truck, and raises the boom above the loading platform. When the operator rotates the bucket in the dumping direction, the cargo in the bucket drops onto the bed and is transferred to the transport machine. The loading operation is performed by repeating such a cycle multiple times.

In the operation of a work machine such as a wheel loader, it is necessary to operate the boom and bucket operation levers to operate the movement of the bucket as well as operate the accelerator to make the work machine run, so it is easy to perform efficient operation. Rather, it requires proficiency. Therefore, there is a demand for a function capable of confirming the operating state of the work machine and providing operational guidance.

In this respect, for example, in Japanese Unexamined Patent Application Publication No. 2016-89388, there is a technique of transmitting information to a remote equipment side and providing a support image for supporting an operator's work on the remote equipment side. disclosed. The support image is generated by considering the relative positional relationship between the work machine and the transport vehicle. However, in the above publication, only a support image regarding the posture of the work machine during work is provided, and it is not possible to easily recognize the posture of the work machine based on what kind of operation command.

JP 2016-89388 A

In view of this point, the present invention has been made to solve the above-mentioned problems, and provides a display system for a work machine and a control method thereof that enable easy recognition of the operation state as well as the operation state of the work machine. intended to provide

A display system for a work machine according to the present invention includes an acquisition unit that acquires operation information and operation information of the work machine; and a display unit for displaying the operation image and the operation image of the work machine.

A method of controlling a display system for a work machine according to the present invention includes steps of acquiring operation information and operation information of the work machine; generating a corresponding operating image; and displaying the operating image and the operating image of the work machine.

The display system for a work machine and the control method thereof according to the present invention make it possible to easily recognize the operation state as well as the operation state of the work machine.

BRIEF DESCRIPTION OF THE DRAWINGS It is a side view of the wheel loader 1 as an example of the working machine according to embodiment. BRIEF DESCRIPTION OF THE DRAWINGS It is a schematic block diagram which shows the structure of the whole system containing the wheel loader 1 according to embodiment. It is a mimetic diagram explaining a work process of wheel loader 1 based on an embodiment. It is a table which shows the discrimination method of the work process of the wheel loader 1 based on embodiment. It is a figure explaining the functional block of the 2nd processing unit 70 according to an embodiment. It is a figure explaining the working machine table stored in the memory 73 according to embodiment. FIG. 10 is a flow diagram illustrating event registration processing of the second processing device 70 according to the embodiment; 3 is a diagram illustrating detailed functional blocks of a motion image generator 82 according to the embodiment; FIG. FIG. 3 is a diagram illustrating a work screen 200 of a display unit 72 according to the embodiment; FIG. FIG. 10 is a flow diagram illustrating playback position selection processing in the second processing device 70 according to the embodiment;

Embodiments of the present invention will be described below with reference to the drawings, but the present invention is not limited thereto. The constituent elements of each embodiment described below can be combined as appropriate. Also, some components may not be used.

[overall structure]
In the embodiments, a wheel loader 1 will be described as an example of a working machine. FIG. 1 is a side view of a wheel loader 1 as an example of a work machine according to an embodiment. As shown in FIG. 1 , the wheel loader 1 includes a vehicle body frame 2 , a working machine 3 , a travel device 4 and a cab 5 . A vehicle body of the wheel loader 1 is composed of a vehicle body frame 2, a cab 5, and the like. A working machine 3 and a traveling device 4 are attached to the vehicle body of the wheel loader 1 .

The traveling device 4 causes the vehicle body of the wheel loader 1 to travel, and includes traveling wheels 4a and 4b. The wheel loader 1 can be self-propelled by rotationally driving the running wheels 4a and 4b, and can perform desired work using the working machine 3. As shown in FIG.

Body frame 2 includes a front frame 11 and a rear frame 12 . The front frame 11 and the rear frame 12 are attached to each other so as to be able to swing in the left-right direction. A steering cylinder 13 is attached to the front frame 11 and the rear frame 12 . The steering cylinder 13 is a hydraulic cylinder. The direction of travel of the wheel loader 1 is changed left and right by the expansion and contraction of the steering cylinder 13 by hydraulic oil from a steering pump (not shown).

In this specification, the direction in which the wheel loader 1 travels straight is referred to as the front-rear direction of the wheel loader 1 . In the front-rear direction of the wheel loader 1, the side on which the work implement 3 is arranged with respect to the body frame 2 is defined as the front direction, and the side opposite to the front direction is defined as the rear direction. The left-right direction of the wheel loader 1 is a direction orthogonal to the front-rear direction in plan view. The right side and the left side in the horizontal direction as viewed from the front are the right side and the left side, respectively. The vertical direction of the wheel loader 1 is a direction orthogonal to a plane defined by the front-rear direction and the left-right direction. In the vertical direction, the side with the ground is the lower side, and the side with the sky is the upper side.

The front-rear direction is the front-rear direction of the operator seated on the driver's seat in the cab 5 . The left-right direction is the left-right direction of the operator seated in the driver's seat. The left-right direction is the vehicle width direction of the wheel loader 1 . The vertical direction is the vertical direction of the operator sitting in the driver's seat. The direction facing the operator sitting in the driver's seat is the front direction, and the rearward direction is the direction behind the operator sitting in the driver's seat. The right and left sides are the right and left directions, respectively, when a worker sitting in the driver's seat faces the front. The foot side of the worker sitting in the driver's seat is the lower side, and the head side is the upper side.

The work machine 3 and running wheels (front wheels) 4a are attached to the front frame 11 . Work implement 3 includes a boom 14 and a bucket 6 . A base end of the boom 14 is rotatably attached to the front frame 11 by a boom pin 10 . The bucket 6 is rotatably attached to the boom 14 by a bucket pin 17 positioned at the tip of the boom 14 . The front frame 11 and boom 14 are connected by a boom cylinder 16 . Boom cylinder 16 is a hydraulic cylinder. The boom 14 is raised and lowered by the expansion and contraction of the boom cylinder 16 by hydraulic oil from the work machine pump 25 (see FIG. 2). Boom cylinder 16 drives boom 14 .

Work implement 3 further includes a bell crank 18 , a tilt cylinder 19 and a tilt rod 15 . The bellcrank 18 is rotatably supported on the boom 14 by a support pin 18a located substantially in the center of the boom 14. As shown in FIG. The tilt cylinder 19 connects the base end of the bell crank 18 and the front frame 11 . The tilt rod 15 connects the tip of the bell crank 18 and the bucket 6 . The tilt cylinder 19 is a hydraulic cylinder. The tilt cylinder 19 is expanded and contracted by the working oil from the work machine pump 25 (see FIG. 2), thereby rotating the bucket 6 up and down. A tilt cylinder 19 drives the bucket 6 .

A cab 5 and running wheels (rear wheels) 4b are attached to the rear frame 12 . The cab 5 is arranged behind the boom 14 . The cab 5 is mounted on the vehicle body frame 2 . A seat on which an operator sits, an operation device, and the like are arranged in the cab 5 .

A position detection sensor 64 is arranged on the upper ceiling side of the cab 5 . Position detection sensor 64 includes a GNSS antenna and a global coordinate calculator. The GNSS antenna is an antenna for a global navigation satellite system (RTK-GNSS (Real Time Kinematic-Global Navigation Satellite Systems). In the cab 5, an IMU (Inertial Measurement Unit) 66 is arranged. , detects the inclination of the body frame 2. The IMU 66 detects the inclination angles of the body frame 2 with respect to the longitudinal direction and the lateral direction.

FIG. 2 is a schematic block diagram showing the configuration of the entire system including the wheel loader 1 according to the embodiment. Referring to FIG. 2, the overall system according to the embodiment includes wheel loader 1 and a second processing device that is provided to communicate with wheel loader 1 by wireless communication or wired communication.

The wheel loader 1 includes an engine 20, a power takeoff section 22, a power transmission mechanism 23, a cylinder driving section 24, a first angle detector 29, a second angle detector 48, a rotating mechanism 60, and a first processing device 30 (controller). It has

Engine 20 is, for example, a diesel engine. The output of engine 20 is controlled by adjusting the amount of fuel injected into the cylinders of engine 20 . A temperature sensor 31 is provided in the engine 20 . The temperature sensor 31 outputs a detection signal indicating temperature to the first processing device 30 .

The power takeoff unit 22 is a device that distributes the output of the engine 20 to the power transmission mechanism 23 and the cylinder driving unit 24 . Power transmission mechanism 23 is a mechanism that transmits driving force from engine 20 to front wheels 4a and rear wheels 4b, and is, for example, a transmission. The power transmission mechanism 23 changes the speed of the rotation of the input shaft 21 and outputs it to the output shaft 23a. A vehicle speed detector 27 for detecting the vehicle speed of the wheel loader 1 is attached to the output shaft 23 a of the power transmission mechanism 23 . The wheel loader 1 includes a vehicle speed detector 27 .

Vehicle speed detector 27 is, for example, a vehicle speed sensor. The vehicle speed detector 27 detects the moving speed of the wheel loader 1 by the traveling device 4 (FIG. 1) by detecting the rotational speed of the output shaft 23a. The vehicle speed detector 27 functions as a rotation sensor for detecting the rotation speed of the output shaft 23a. The vehicle speed detector 27 functions as a movement detector that detects movement by the travel device 4 . The vehicle speed detector 27 outputs a detection signal indicating the vehicle speed of the wheel loader 1 to the first processing device 30 .

The cylinder driving section 24 has a working machine pump 25 and a control valve 26 . The output of engine 20 is transmitted to work implement pump 25 via power take-off portion 22 . Hydraulic oil discharged from work machine pump 25 is supplied to boom cylinder 16 and tilt cylinder 19 via control valve 26 .

The boom cylinder 16 is provided with first oil pressure detectors 28 a and 28 b for detecting the oil pressure in the oil chamber of the boom cylinder 16 . The wheel loader 1 includes first oil pressure detectors 28a, 28b. The first oil pressure detectors 28a and 28b have, for example, a head pressure detection pressure sensor 28a and a bottom pressure detection pressure sensor 28b.

The pressure sensor 28 a is attached to the head side of the boom cylinder 16 . The pressure sensor 28 a can detect the pressure of hydraulic oil in the cylinder head side oil chamber of the boom cylinder 16 (head pressure). The pressure sensor 28 a outputs a detection signal indicating the head pressure of the boom cylinder 16 to the first processing device 30 . The pressure sensor 28b is attached to the bottom side of the boom cylinder 16. As shown in FIG. The pressure sensor 28 b can detect the pressure (bottom pressure) of hydraulic oil in the cylinder bottom side oil chamber of the boom cylinder 16 . The pressure sensor 28 b outputs a detection signal indicating the bottom pressure of the boom cylinder 16 to the first processing device 30 .

First angle detector 29 is, for example, a potentiometer attached to boom pin 10 . The first angle detector 29 detects a boom angle representing the lift angle (tilt angle) of the boom 14 . The first angle detector 29 outputs a detection signal indicating the boom angle to the first processing device 30 . Specifically, as shown in FIG. 1 , the boom angle θ is the angle of a straight line LB extending from the center of the boom pin 10 toward the center of the bucket pin 17 with respect to a horizontal line extending forward from the center of the boom pin 10 . It is defined that the boom angle θ=0° when the straight line LB is horizontal. The boom angle θ is positive when the straight line LB is above the horizontal line. The boom angle θ is negative when the straight line LB is below the horizontal line. Note that the first angle detector 29 may be a stroke sensor arranged on the boom cylinder 16 .

The second angle detector 48 is, for example, a potentiometer attached to the support pin 18a. The second angle detector 48 detects the angle of the bell crank 18 with respect to the boom 14 (bell crank angle) to detect the bucket angle representing the tilt angle of the bucket 6 with respect to the boom 14 . The second angle detector 48 outputs a detection signal indicating the bucket angle to the first processing device 30 . The bucket angle is, for example, the angle between the straight line connecting the center of the bucket pin 17 and the cutting edge 6a of the bucket 6 and the straight line LB. Note that the second angle detector 48 may be a stroke sensor arranged on the tilt cylinder 19 .

The rotating mechanism 60 rotatably connects the front frame 11 and the rear frame 12 . Rotation of the front frame 11 with respect to the rear frame 12 is performed by extending and contracting an articulated cylinder connected between the front frame 11 and the rear frame 12 . By bending (articulating) the front frame 11 with respect to the rear frame 12, it is possible to make the turning radius of the wheel loader smaller when turning, and to perform ditch digging and cutting work by offset traveling. be. The rotating mechanism 60 is provided with an articulate angle sensor 61 . The articulate angle sensor 61 detects an articulate angle. The articulate angle sensor 61 outputs a detection signal indicating the articulate angle to the first processing device 30 .

The position detection sensor 64 outputs a detection signal indicating the position of the wheel loader 1 to the first processing device 30 . The IMU 66 outputs a detection signal indicating the tilt angle of the wheel loader 1 to the first processing device 30 .

As shown in FIG. 2, the wheel loader 1 has an operating device in the cab 5 that is operated by an operator. The operating devices include a forward/reverse switching device 49 , an accelerator operating device 51 , a boom operating device 52 , a shift operating device 53 , a bucket operating device 54 and a brake operating device 58 .

The forward/reverse switching device 49 includes a forward/reverse switching operation member 49a and a forward/reverse switching detection sensor 49b. The forward/reverse switching operation member 49a is operated by the operator to instruct switching between forward and reverse of the vehicle. The forward/reverse switching operation member 49a can be switched to forward (F), neutral (N), and reverse (R) positions. The forward/reverse switching detection sensor 49b detects the position of the forward/reverse switching operation member 49a. The forward/reverse switching detection sensor 49b outputs a forward/rearward command detection signal (forward, neutral, reverse) represented by the position of the forward/reverse switching operation member 49a to the first processing device 30 . The forward/reverse switching device 49 includes an FNR switching lever capable of switching between forward (F), neutral (N) and reverse (R).

The accelerator operation device 51 includes an accelerator operation member 51a and an accelerator operation detector 51b. The accelerator operation member 51a is operated by an operator to set a target rotation speed of the engine 20. FIG. The accelerator operation detection unit 51b detects the operation amount (accelerator operation amount) of the accelerator operation member 51a. The accelerator operation detection unit 51b outputs a detection signal indicating the amount of accelerator operation to the first processing device 30 .

The brake operation device 58 includes a brake operation member 58a and a brake operation detector 58b. The brake operation member 58a is operated by an operator to operate the deceleration force of the wheel loader 1. As shown in FIG. The brake operation detector 58b detects the amount of operation (brake operation amount) of the brake operation member 58a. The brake operation detector 58b outputs to the first processing device 30 a detection signal indicating the amount of brake operation. The brake oil pressure may be used as the brake operation amount.

The boom operation device 52 includes a boom operation member 52a and a boom operation detector 52b. The boom operating member 52a is operated by an operator to raise or lower the boom 14. As shown in FIG. The boom operation detector 52b detects the position of the boom operation member 52a. The boom operation detection unit 52b outputs to the first processing device 30 a detection signal of a command to raise or lower the boom 14 represented by the position of the boom operation member 52a.

The shift operation device 53 includes a shift operation member 53a and a shift operation detector 53b. The shift operation member 53a is operated by an operator to control the shift of the power transmission mechanism 23 from the input shaft 21 to the output shaft 23a. The shift operation detector 53b detects the position of the shift operation member 53a. The shift operation detector 53b outputs to the first processing device 30 a shift detection command represented by the position of the shift operation member 53a.

The bucket operation device 54 includes a bucket operation member 54a and a bucket operation detection section 54b. The bucket operating member 54a is operated by an operator to excavate or dump the bucket 6. As shown in FIG. The bucket operation detector 54b detects the position of the bucket operation member 54a. The bucket operation detection unit 54b outputs to the first processing device 30 a detection signal indicating an operation command for tilting the bucket 6 in the tilt-back direction or the dumping direction, which is represented by the position of the bucket operation member 54a.

The articulate operation device 55 includes an articulate operation member 55a and an articulate operation detector 55b. The articulate operation member 55 a is operated by the operator to bend (articulate) the front frame 11 with respect to the rear frame 12 via the rotation mechanism 60 . The articulate operation detector 55b detects the position of the articulate operation member 55a. The articulate operation detection unit 55b outputs to the first processing device 30 a detection signal of a leftward bending command or a rightward bending command represented by the position of the articulate operation member 55a.

The first processing unit 30 is composed of a storage device such as a RAM (Random Access Memory) and a ROM (Read Only Memory), and a microcomputer including an arithmetic device such as a CPU (Central Processing Unit). The first processing device 30 may be realized as a part of the function of the controller of the wheel loader 1, which controls the operations of the engine 20, the working machine 3 (the boom cylinder 16, the tilt cylinder 19, etc.), the power transmission mechanism 23, and the like. good. The first processing device 30 stores a forward/rearward command signal detected by the forward/reverse switching device 49 , a vehicle speed signal of the wheel loader 1 detected by the vehicle speed detector 27 , and a signal detected by the first angle detector 29 . A signal of the boom angle detected by the pressure sensor 28a, a signal of the head pressure of the boom cylinder 16 detected by the pressure sensor 28a, and a signal of the bottom pressure of the boom cylinder 16 detected by the pressure sensor 28b are mainly input.

The wheel loader 1 further has a display section 40 and an output section 45 . The display unit 40 is a monitor arranged in the cab 5 and viewed by the operator.

The output unit 45 outputs working machine operation information including operation information of the wheel loader 1 to a server (second processing device 70 ) installed outside the wheel loader 1 . The output unit 45 may output the work machine operation information including the operation information of the wheel loader 1 for each predetermined period, or may collectively output the work machine operation information for a plurality of periods. The output unit 45 may have, for example, a communication function such as wireless communication, and communicate with the second processing device 70 . Alternatively, the output unit 45 may be, for example, an interface of a portable storage device (such as a memory card) accessible by the second processing device 70 . The second processing unit 70 has a display unit serving as a monitor function, and can display a motion image based on the work machine motion information output from the output unit 45 . The second processing device 70 is provided at a position different from that of the wheel loader 1, and as an example, it is possible to recognize an operation image of the wheel loader 1 during work on the display unit at a remote location.

[Work process of wheel loader 1 and its determination]
The wheel loader 1 of the present embodiment performs an excavation operation of scooping an excavation object such as earth and sand into the bucket 6 and a loading operation of loading the load (excavation object 100) in the bucket 6 onto a transport machine such as a dump truck 110. to run.

FIG. 3 is a schematic diagram for explaining the work process of the wheel loader 1 based on the embodiment. The wheel loader 1 excavates the object 100 to be excavated and loads the object 100 to be excavated on a transport machine such as a dump truck 110 by repeating the following steps in sequence.

As shown in FIG. 3A, the wheel loader 1 advances toward the excavation object 100. As shown in FIG. In this empty forwarding process, the operator operates the boom cylinder 16 and the tilt cylinder 19 to place the working machine 3 in the digging posture in which the tip of the boom 14 is at a low position and the bucket 6 is oriented horizontally. is advanced toward the object 100 to be excavated.

As shown in FIG. 3B, the operator advances the wheel loader 1 until the cutting edge 6a of the bucket 6 bites into the excavation object 100. As shown in FIG. In this excavation (plunging) process, the cutting edge 6 a of the bucket 6 bites into the excavation object 100 .

As shown in FIG. 3C, the operator then operates the boom cylinder 16 to raise the bucket 6 and operates the tilt cylinder 19 to tilt the bucket 6 back. By this excavation (scooping) step, the bucket 6 rises along the bucket locus L as indicated by the curved arrow in the figure, and the excavation object 100 is scooped into the bucket 6 . Thus, the excavation work of scooping up the excavation object 100 is performed.

Depending on the type of the object 100 to be excavated, the scooping process may be completed only by tilting back the bucket 6 once. Alternatively, in the scooping process, the operation of tilting the bucket 6 back, bringing it to a neutral position, and tilting it back again may be repeated.

As shown in FIG. 3(D), after the bucket 6 scoops the object 100 to be excavated, the operator causes the wheel loader 1 to move backward in the load backward process. The operator may raise the boom while moving backward, or may raise the boom while moving forward in FIG. 3(E).

As shown in FIG. 3(E) , the operator moves the wheel loader 1 forward to approach the dump truck 110 while keeping the bucket 6 raised or raising the bucket 6 . Due to this load forwarding process, the bucket 6 is positioned almost directly above the bed of the dump truck 110 .

As shown in FIG. 3F , the operator dumps the bucket 6 at a predetermined position and loads the load (the object to be excavated) in the bucket 6 onto the platform of the dump truck 110 . This process is a so-called earth removal process. After that, the operator lowers the boom 14 while moving the wheel loader 1 backward, and returns the bucket 6 to the digging posture. The above is a typical process forming one cycle of excavation and loading work.

FIG. 4 is a table showing a method of determining work processes of the wheel loader 1 based on the embodiment. In the table shown in FIG. 4, the names of the work processes shown in FIGS. 3(A) to 3(F) are shown in the top row of "work process". In the rows of "Forward/reverse switching lever", "Working machine operation" and "Working machine cylinder pressure" below it, the first processing unit 30 (Fig. , FIG. 3), various criteria are shown. More specifically, in the row of "Forward/reverse switching lever", the determination conditions for the forward/reverse switching lever are indicated by circles.

In the row of "work machine operation", the determination conditions for the operator's operation of the work machine 3 are indicated by circles. More specifically, the row of "BOOM" shows the determination conditions regarding the operation of the boom 14, and the row of "BUCKET" shows the determination conditions of the operation of the bucket 6.

The row of "working machine cylinder pressure" shows the determination condition for the current hydraulic pressure of the cylinder of the working machine 3, for example, the hydraulic pressure of the cylinder bottom chamber of the boom cylinder 16. FIG. Here, four reference values A, B, C, and P are set in advance for the hydraulic pressure, and these reference values A, B, C, and P provide a plurality of pressure ranges (ranges less than the reference value P, reference values A to C , the range from reference value B to P, and the range below reference value C) are defined, and these pressure ranges are set as the judgment conditions. The magnitudes of the four reference values A, B, C, and P are A>B>C>P.

By using the combination of determination conditions of the "forward/reverse switching lever", "boom", "bucket", and "working machine cylinder pressure" for each work process as described above, the first processing device 30 can It is possible to determine which process the process is.

A specific operation of the first processing device 30 when performing the control shown in FIG. 4 will be described below. Combinations of determination conditions of "forward/reverse switching lever", "boom", "bucket" and "work equipment cylinder pressure" corresponding to each work process shown in FIG. 4 are stored in advance in storage unit 30j (FIG. 2). ing. Based on the signal from the forward/reverse switching device 49, the first processing device 30 grasps the currently selected forward/reverse switching lever (F, N, R). The first processing device 30 grasps the type of current operation (lowering, neutral or raising) for the boom 14 based on the signal from the boom operation detection section 52b. The first processing device 30 grasps the type of current operation (dump, neutral or tilt back) for the bucket 6 based on the signal from the bucket operation detector 54b. Further, the first processing device 30 grasps the current oil pressure in the cylinder bottom chamber of the boom cylinder 16 based on the signal from the pressure sensor 28b shown in FIG.

The first processing device 30 stores the grasped current combination of the forward/reverse switching lever, the boom operation type, the bucket operation type, and the lift cylinder oil pressure (i.e., the current work state) in correspondence with each work process stored in advance. Compare with the combination of judgment conditions of "forward/reverse switching lever", "boom", "bucket" and "work equipment cylinder pressure". As a result of this contrasting process, the first processing device 30 determines which work step corresponds to the combination of determination conditions that best matches the current work state. Here, an example of a combination of determination conditions corresponding to the excavation and loading operation shown in FIG. 4 is as follows.

In the empty forward stroke, the forward/reverse switching lever is at F, both the boom operation and the bucket operation are neutral, and the work equipment cylinder pressure is less than the reference value P. In the excavation (plunging) process, the forward/reverse switching lever is F, both the boom operation and the bucket operation are neutral, and the working machine cylinder pressure is in the range of reference values A to C. In the excavation (scooping) process, the forward/reverse switching lever is F or R, the boom operation is raised or neutral, the bucket operation is tilt back, and the working machine cylinder pressure is within the range of reference values A to C. As for the bucket operation, a further determination condition may be added in which tilt back and neutral are alternately repeated. This is because, depending on the state of the object to be excavated, the operation of tilting the bucket 6 back, bringing it to neutral, and tilting it back again may be repeated. In the loaded reverse process, the forward/reverse switching lever is at R, the boom operation is at neutral or raised, the bucket operation is at neutral, and the work equipment cylinder pressure is in the range of reference values B to P. In the load forward process, the forward/reverse switching lever is F, the boom operation is raised or neutral, the bucket operation is neutral, and the work equipment cylinder pressure is in the range of reference values B to P. In the dumping process, the forward/reverse switching lever is F, the boom is raised or neutral, the bucket is dumped, and the working machine cylinder pressure is in the range of reference values B to P. In the reverse/boom lowering process, the forward/reverse switching lever is R, the boom is lowered, the bucket is tilted back, and the work equipment cylinder pressure is less than the reference value P.

Information about the work process determined by the first processing device 30 is output to the second processing device 70 via the output unit 45 as part of the work machine operation information. In this example, the method of determining the work process by the first processing device 30 will be described, but the method is not limited to this, and the work process may be determined by the second processing device 70 .

[Functional Configuration of Second Processing Device 70]
FIG. 5 is a diagram illustrating functional blocks of the second processing device 70 according to the embodiment. Referring to FIG. 5, second processing device 70 includes an input unit 71 , a display unit 72 , a memory 73 , a communication unit 74 and a CPU 75 .

The input unit 71 includes a mouse, keyboard, controller, touch panel, and the like. An input command is generated by operating the input unit 71 . For example, an input command is generated by mouse operation, keyboard operation, button operation of a controller, or touch operation of a touch panel.

The display unit 72 includes a display such as a liquid crystal display. The memory 73 includes storage devices such as RAM and ROM. The memory 73 stores programs read by the CPU 75 to implement functional blocks that execute various processes. The memory 73 also stores the work machine operation information transmitted from the wheel loader 1 as work machine operation data.

The second processing device 70 according to the embodiment uses the work machine operation data stored in the memory 73 to generate and display an operation image showing the operating state of the wheel loader 1 during operation. The work machine operation data will be described later. In this example, the second processing device 70 uses the work machine operation data to display in real time an operation image showing the operating state of the wheel loader 1 during operation. Reproduction processing can also be performed using the work machine operation data stored in the memory 73 . Note that the reproduction process includes both a still image at a certain point in time and a moving image that continuously changes over time.

The CPU 75 implements various functional blocks based on programs stored in the memory 73 . Specifically, the CPU 75 includes a selection section 80 , an action image generation section 82 , a display control section 84 , an event determination section 86 and an event registration section 88 .

The selection unit 80 selects the time of the work machine operation data stored in the memory 73 as the reproduction time when performing the reproduction process. The motion image generator 82 generates motion image data of the wheel loader 1 based on the work machine motion data. Based on the motion image data of the wheel loader 1 generated by the motion image generation portion 82, the display control portion 84 outputs the work screen including the motion image to the display portion 72 for display. Event determination unit 86 determines whether an event has occurred based on the work machine operation information stored in memory 73 . The event registration unit 88 associates the event information regarding the event determined by the event determination unit 86 with the work machine operation information and stores the event information in the memory 73 . The second processing device 70 is an example of the "work machine display system" of the present invention. The selection unit 80, the motion image generation unit 82, the event determination unit 86, the event registration unit 88, the display unit 72, and the memory 73 correspond to the "selection unit", the "motion image generation unit", and the "event determination unit" of the present invention, respectively. ”, “event registration unit”, “display unit”, and “storage unit”.

FIG. 6 is a diagram illustrating a work machine table stored in memory 73 according to the embodiment. Referring to FIG. 6, the work machine table includes work machine operation data arranged in chronological order.

As an example, the work machine table stores a plurality of work machine operation data. Specifically, the chronological work times "12:01:01", "12:01:05", "12:01:10", "12:02:00", "12:02:04", work machine operation data associated with each. The work time corresponds to, for example, the time when the communication unit 74 of the second processing device 70 receives the data (working machine operation information) transmitted from the output unit 45 of the first processing device 30 . Note that the time is not limited to the time when the communication unit 74 of the second processing device 70 receives the information, and may be the time when the output unit 45 of the first processing device 30 transmits the information. You may use it.

The work machine operational data includes work machine operational information and event information associated with the work machine operational information.

Event information is information about an event that has occurred. The event information is set by the event registration unit 88, which will be described later. Therefore, the event information of the work machine operation data is blank before being set by the event registration unit 88 .

The work machine operation information includes vehicle information CN associated with work time, operation information T, position information P, worker ID, and vehicle body ID. The vehicle information CN is information on the wheel loader 1 . Specifically, the vehicle information CN includes information about the work implement 3 and the vehicle including the travel device 4 other than the work implement 3 and the like. In this example, the vehicle information CN includes both the work machine 3 and the vehicle (machine main body) information, but either one of them may be included. The information about the work implement 3 includes detection signals from the first angle detector 29, the second angle detector 48, the first oil pressure detectors 28a and 28b, and work implement data relating to work processes. It is possible to detect the attitude state and the like of the work machine 3 from the work machine data.

The information on the vehicle includes vehicle data on detection signals from the temperature sensor 31 , the vehicle speed detector 27 and the articulate angle sensor 61 . It is possible to detect the state of the traveling device 4 and the like from the vehicle data. The operation information T includes work machine operation information for the work machine 3 and vehicle operation information. The work implement operation information includes work implement operation data related to the detection signals of the boom operation detection section 52b and the bucket operation detection section 54b. It is possible to detect the operation state of the work machine 3 from the work machine operation data. The vehicle operation information includes vehicle operation data relating to detection signals from the forward/reverse switching operation member 49a, the accelerator operation detection unit 51b, the shift operation detection unit 53b, the articulate operation detection unit 55b, and the brake operation detection unit 58b. It is possible to detect the operation state of the vehicle from the vehicle operation data. In this example, the operation information T includes both the working machine operation information and the vehicle operation information, but either one of them may be included.

The position information P is information regarding the position of the wheel loader 1 . Specifically, the position information P includes position data regarding the detection signal of the position detection sensor 64 and tilt data regarding the detection signal of the IMU 66 .

The operator ID is information that identifies the operator of the wheel loader 1 . As an example, it is assumed that the worker ID is stored in advance in the key that the worker uses to start the engine of the work machine. The first processing device 30 acquires the worker ID from the key when starting the engine of the work machine.

The vehicle body ID is information for identifying the vehicle body of the wheel loader 1 . As an example, it is assumed that the vehicle body ID is stored in advance in the storage unit 30j of the first processing device 30. FIG. In this example, the case where the information is stored in the storage unit 30j of the first processing device 30 will be described, but the information is not limited to this and may be stored in the memory 73 of the second processing device 70 in advance.

[Event registration process]
FIG. 7 is a flowchart illustrating event registration processing of the second processing device 70 according to the embodiment. The event registration processing can be executed as background processing in parallel with the motion image generation processing for generating a motion image showing the motion state of the wheel loader 1 during work. Referring to FIG. 7, event determination unit 86 acquires the work machine operation data stored in the work machine table of memory 73 (step ST0).

Next, the event determination section 86 determines whether an event has occurred based on the acquired working machine operation data (step ST4). The event determination unit 86 determines whether or not the acquired work machine operation data satisfies a predetermined event condition.

As an example of an event condition, in this example, it is determined that an overheat event has occurred when the temperature is equal to or higher than a predetermined temperature. For example, information about the vehicle included in the vehicle information CN includes vehicle data about the detection signal of the temperature sensor 31 . The event determination unit 86 determines whether the temperature is equal to or higher than a predetermined temperature based on the data of the detection signal of the temperature sensor 31 .

As another event condition, in this example, it is determined that an event has occurred from work process information. For example, the vehicle information CN includes work machine data including work processes. Event determination unit 86 determines whether an event has occurred based on the work machine data. If the work machine data includes information on the excavation work process, it is determined that an excavation event has occurred.

Note that it is possible to provide various event conditions without being limited to this, and it may be determined that a predetermined event has occurred using one data of the acquired work machine operation information, or a combination of a plurality of data. It may be determined that a predetermined event has occurred based on.

In step ST4, when the event determination section 86 determines that an event has occurred (YES in step ST4), it instructs the event registration section 88 to register.

Next, the event registration section 88 registers the event information according to the registration instruction from the event determination section 86 (step ST6).

Next, the event registration unit 88 determines whether or not confirmation of all work machine operation data included in the work machine table has been completed (step ST8).

In step ST8, when the event registration unit 88 determines that confirmation of all work machine operation data has been completed (YES in step ST8), the event registration process ends (END). On the other hand, in step ST8, when the event registration unit 88 determines that confirmation of all work machine operation data has not been completed (NO in step ST8), the process returns to step ST0 to The work machine operation data in the table is acquired, and the above processing is repeated.

For example, when an overheating event has occurred, the event registration unit 88 registers the event information in the work machine operation data as event information associated with the work machine operation information. Further, as an example, when an excavation event occurs, the event registration unit 88 registers it as event information associated with the work machine operation information in the work machine operation data. The same applies to other work machine operation data. Thereby, the event information shown in FIG. 6 is set.

[Motion image generation processing]
FIG. 8 is a diagram illustrating detailed functional blocks of the motion image generator 82 according to the embodiment. 8, motion image generator 82 includes motion state image generator 820, position state image generator 822, vehicle state image generator 824, management information image generator 826, and event information image generator. 828. Each functional block of the motion image generator 82 is implemented by a program stored in advance in the memory 73 .

The operation state image generator 820 generates operation state image data based on the work machine operation data. The position state image generator 822 generates position state image data based on the work machine operation data. Vehicle state image generation unit 824 generates vehicle state image data based on the work machine operation data. A management information image generator 826 generates management information image data based on the work machine operation data. The event information image generator 828 generates event information image data based on the work machine operation data.

FIG. 9 is a diagram illustrating the work screen 200 of the display unit 72 according to the embodiment. 9, work screen 200 is provided with a plurality of screens displaying various information of wheel loader 1 corresponding to work time of wheel loader 1 "2018/1/1/12:02:00". It is The multiple screens are screens synchronized with the working time. In this example, the motion image generator 82 generates motion image data of the wheel loader 1 based on the work machine motion data corresponding to the work time stored in the work machine table. Note that the playback time may be information only about the time, or may include information about the date.

The display control unit 84 displays the work screen 200 on the display unit 72 based on the motion image data generated by the motion image generation unit 82 . In this example, the motion image data includes motion state image data, position state image data, vehicle state image data, management information image data, and event information image data.

Specifically, the display control unit 84 displays the operation screen 210 representing the movement of the wheel loader 1 on the display unit 72 based on the operation state image data. The display control unit 84 displays a position screen 230 representing the wheel loader 1 on the display unit 72 based on the position state image data. The display control unit 84 displays a state screen 220 showing information on the state of the wheel loader 1 on the display unit 72 based on the vehicle state image data. The display control unit 84 displays an event display screen 240 displaying a list of events occurring in the wheel loader 1 on the display unit 72 based on the event information image data. The display control unit 84 displays a management screen 260 showing management information of the wheel loader 1 on the display unit 72 based on the management information image data.

Note that the display control unit 84 may provide a command bar for instructing various commands related to the reproduction process on the work screen 200. FIG. The command bar includes a play button, a stop button, a pause button, a fast forward button, a fast reverse button, and the like. By operating the button, the administrator can execute various processes related to the reproduction process. When the administrator operates the playback button, continuous playback processing (moving image playback processing) of motion images of the wheel loader 1 following temporal changes from a certain playback time is executed. When the administrator operates the pause button, a motion image reproduction process (still image reproduction process) of the wheel loader 1 according to a certain reproduction time is executed.

[Operation screen 210]
The operation screen 210 is displayed based on the operation state image data. Operation screen 210 includes tilt state image 212 , articulate state image 214 , and work state image 216 .

The operating state image generation unit 820 generates first operating state image data based on the 3D model shape data for generating a reference image of the 3D model shape of the wheel loader 1 and the working machine data included in the vehicle information CN. It is assumed that the 3D model shape data is stored in the memory 73 in advance. The 3D model shape data includes data of each model shape such as a working machine, a vehicle body, wheels, etc., which form a reference image of the 3D model shape. Also, the first operating state image data may be image data representing the inclination or articulated angle of the vehicle.

The display control unit 84 displays the working state image 216 showing the working state of the wheel loader 1 based on the first operating state image data. The work state image 216 includes a work machine model image 217 representing a 3D model of the wheel loader 1 and a road surface image 218 representing a road surface model on which the wheel loader 1 travels.

The display control unit 84 can represent by combining the running state of the working machine model image 217 and the road surface image 218 . Specifically, as an example, by sliding the road surface image 218 from left to right, it is possible to represent the forward movement of the working machine model image 217 without changing the position of the working machine model image 217 . Further, the display control unit 84 may express the extent of the running state of the working machine model image 217 by adjusting the moving speed of the road surface image 218 . For example, the display control unit 84 may increase the slide speed of the road surface image 218 so that the working machine model image 217 appears to move forward at high speed. Conversely, the display control unit 84 may slow down the slide speed of the road surface image 218 to make it appear as if the working machine model image 217 is moving forward at a low speed. The display control unit 84 may adjust the slide speed of the road surface image 218 based on the vehicle speed data included in the vehicle information CN. Display control unit 84 displays working machine model image 217 based on the first operation state image data. Thereby, it is possible to visualize the state of the work of the wheel loader 1 during work. It is also possible to change the field of view by accepting the setting of the direction of the field of view of the virtual camera when visualizing the working state. The work machine model image 217 is arranged in the virtual space, and the image of the work machine model image 217 captured by the virtual camera from a predetermined image pickup position is displayed. The imaging position of the virtual camera can be set to an arbitrary position, and by adjusting the position, it is possible to display the working machine model image 217 photographed from an arbitrary angle.

The operating state image generation unit 820 generates second operating state image data based on the side shape model data for generating the reference image of the shape of the side model of the wheel loader 1 and the tilt data included in the position information P. The display control unit 84 displays the tilt state image 212 based on the second operating state image data. The tilted state image 212 indicates the tilted state of the vehicle body of the wheel loader 1 . In this example, a case of being inclined at 25° is shown. The display control unit 84 displays the tilt state image 212 based on the second operating state image data. As a result, it is possible to visualize the leaning state of the vehicle body while the wheel loader 1 is working.

The operating state image generation unit 820 generates third operating state image data based on the top view shape model data for generating a reference image of the shape of the top view model of the wheel loader 1 and the articulated angle data included in the vehicle information CN. to generate The display control unit 84 displays the articulated state image 214 based on the third operating state image data. The articulate state image 214 shows the articulated state of the wheel loader 1 . In this example, the case of being bent rightward by 15° is shown. The display control unit 84 displays the articulated state image 214 based on the third operating state image data. Thereby, it is possible to visualize the articulated state during operation of the wheel loader 1 .

[Status screen 220]
The state screen 220 is displayed based on the vehicle state image data. The state screen 220 includes a time bar 224 indicating work time during work, an operation state image 221 , a vehicle state image 222 and a work process state image 223 . Here, the time bar 224 indicates the work time during work. The time bar 224 in this example is movably provided to a position corresponding to an arbitrary work time.

The vehicle state image generation unit 824 generates first vehicle state image data based on the operation information T of the work machine operation data from the current work time to a predetermined period before. The display control unit 84 displays an operation state image 221 indicating the state of the operation member operated by the operator for a predetermined period based on the first vehicle state image data. The operation state image 221 includes an operation designation state image 221A corresponding to the current work time, and an operation transition state image 221B showing the transition state of the operation from the current work time to a predetermined period before. The operation designation state image 221A shows the states of the accelerator operation device 51 (accelerator pedal), the boom operation device 52 (boom lever), the bucket operation device 54 (bucket lever), and the brake operation device 58 (brake). In this example, the accelerator pedal is 95%, the boom lever is 25%, the bucket lever is 14%, and the brake is OFF. The operation transition state image 221B shows the accelerator operating device 51 (accelerator pedal), the boom operating device 52 (boom lever), the bucket operating device 54 (bucket lever), the brake operating device 58 (brake ) indicates the transition state of the operation.

Regarding the accelerator operation device 51 (accelerator pedal), the boom operation device 52 (boom lever), and the bucket operation device 54 (bucket lever), the operation states are shown in grayscale. Specifically, the higher the value of the operation ratio of the operating member, the darker (black) the display, and the lower the value, the lighter (white) the display. In addition, in this example, the case where the operation state is displayed in grayscale is described, but the operation state may be displayed in a heat map. For example, by changing the color when the boom operation device 52 (boom lever) is raised or lowered, it is possible to intuitively grasp which operation it is. The same applies to the bucket operating device 54 (bucket lever). Also, the value of the operation amount of the operation member may be graphed and displayed. As for the brake operating device 58 (brake), the state of the brake being on or off is displayed. As a result, it is possible to easily grasp what kind of operation was performed on the operation member during the predetermined period.

The vehicle state image generation unit 824 generates second vehicle state image data based on the vehicle information CN of the work machine operation data from the current work time to a predetermined period before. The display control unit 84 displays a vehicle state image 222 and a work process state image 223 showing the state of the wheel loader 1 for a predetermined period based on the second vehicle state image data. The vehicle state image 222 includes a designated vehicle state image 222A corresponding to the current work time, and a vehicle transition state image 222B showing the transition state of the vehicle from the current work time to a predetermined period before. In this example, the vehicle designation state image 222A shows the case where the vehicle speed of the wheel loader 1 is 15 km/h.

The vehicle transition state image 222B shows the transition state of the vehicle speed of the wheel loader 1 in a predetermined period (26 s in this example). Thereby, it is possible to easily grasp how the vehicle speed of the wheel loader 1 has changed in a predetermined period.

The work process state image 223 includes a work process designation state image 223A showing the work process corresponding to the current work time, and a work process transition state image 223B showing the transition state of the work process from the current work time to a predetermined period before. including. The work process designation state image 223A shows a case of excavation in this example. The work process transition state image 223B shows a case where the transition of the work process during a predetermined period is changed to empty advance, excavation, and loaded advance. Thereby, it is possible to easily grasp how the work process of the wheel loader 1 has changed in a predetermined period.

As an example, the display control unit 84 controls the operation transition state image 221B, the vehicle transition state image 222B, and the work process transition state image 223B to move from the right side to the left side in accordance with the work time corresponding to the time bar 224. The time bar 224 can be changed to any work time position within a predetermined period based on the input from the input unit 71 .

[Position screen 230]
The position screen 230 is displayed based on the position state image data. The position screen 230 includes a work position image 232 and a movement trajectory image 234 .

The position state image generation unit 822 generates position state image data based on the map data indicating the work map and the position data included in the position information P. FIG. The display control unit 84 displays a work position image 232 indicating the work position of the wheel loader 1 on the work map and a movement locus image 234 indicating the movement locus of the wheel loader 1 based on the position state image data. The work position image 232 is provided so that it can be moved according to a movement trajectory image 234 showing the movement trajectory of the wheel loader 1 . The display control unit 84 displays the work position image 232 and the movement trajectory image 234 on the work map based on the position state image data. This makes it possible to visualize the moving state of the wheel loader 1 during work. Also, the movement trajectory image 234 includes a speed change area 233 . A speed change region 233 indicates a region where the movement speed of the wheel loader 1 has changed. By providing the speed change area 233 in the movement locus image 234, it is possible to visually determine the speed change of the wheel loader 1. FIG. In this example, one speed change region 233 is shown, but the speed change region 233 is not particularly limited to this, and a plurality of regions may be provided. Here, as an example, a state in which the speed has changed due to a change in hatching pattern is shown. It should be noted that the change in speed of the wheel loader 1 may be visually determined not only by this display but also by color or other highlighting. The work position image 234 can be changed to any work position along the movement locus image 234 based on the input from the input unit 71 .

[Event display screen 240]
The event display screen 240 is displayed based on the event information image data. Event display screen 240 includes an event list. The event information image generator 828 generates event information image data based on the event information of the work machine operation data. The display control unit 84 displays the event list based on the event information image data. In this example, overheating and work processes are shown as events. The work processes are further subdivided into processes such as excavation and empty advance. Also, the time of each event is displayed in a tree format.

In this example, the item of the time when the event occurred displayed in a tree format is provided so as to be selectable. For example, by designating the item of the overheated time "2018/1/1/12:20:00", the work machine operation data of the work machine table associated with the time is selected. Then, motion image data of the wheel loader 1 is generated based on the selected work machine motion data. Thereby, it is possible to easily visualize the event occurrence state during the operation of the wheel loader 1 .

[Management screen 260]
The management screen 260 is displayed based on the management information image data. The management screen 260 includes a time image 202 indicating work time, a vehicle body ID image 204, and a worker ID image 206. FIG. Management information image generator 826 generates first management information image data based on the time information of the work machine operation data. The display control unit 84 displays the time image 202 corresponding to the work time based on the first management information image data. In this example, “2018/1/1:12:02:00” is displayed as the time image 202 .

The management information image generator 826 generates second management information image data based on the vehicle body ID of the working machine operation data. The display control unit 84 displays the vehicle body ID image 204 based on the second management information image data. In this example, “X” is displayed as the body ID image 204 .

The management information image generator 826 generates third management information image data based on the worker ID of the work machine operation data. The display control unit 84 displays the worker ID image 206 based on the third management information image data. In this example, "A" is displayed as the worker ID image. The display control unit 84 displays the time, vehicle body ID, and worker ID based on the first to third management information image data. Thereby, it is possible to easily visualize the management information regarding the wheel loader 1 during operation.

[Playback position selection processing]
In the embodiment, the administrator can select the playback position of the motion image of the wheel loader 1. FIG. FIG. 10 is a flow diagram illustrating playback position selection processing in the second processing device 70 according to the embodiment. Referring to FIG. 10, selection unit 80 determines whether or not an input from input unit 71 has been received (step S2). If the selection unit 80 does not accept an input from the input unit 71, the selection unit 80 maintains the state of step S2.

Next, when selecting unit 80 determines that an input from input unit 71 has been received (YES in step S2), it determines whether or not there is an operation input of time bar 224 (step S4). When selecting unit 80 determines that the operation input of time bar 224 is not performed (NO in step S4), the process proceeds to step S20.

On the other hand, when selecting unit 80 determines that there is an operation input of time bar 224 (YES in step S4), selection unit 80 accepts a command to select the position of time bar 224 (step S6). For example, the position at which the operation by the input unit 71 is finished is accepted as the selection command for the position of the time bar 224 .

Next, the selection unit 80 selects the work time corresponding to the position of the time bar 224 as the reproduction time (step S9). Next, motion image generator 82 generates motion image data of wheel loader 1 based on the work machine motion data according to the reproduction time selected by selector 80 (step S10).

Next, the display control unit 84 executes reproduction processing based on the motion image data of the wheel loader 1 generated by the motion image generation unit 82 (step S12). Specifically, as described with reference to FIG. 8, the display control unit 84 outputs the work screen including the motion image to the display unit 72 for display. By selecting the position of the time bar 224 , the administrator can execute the motion image reproduction process at any reproduction position corresponding to the position of the time bar 224 .

Next, the display control unit 84 determines whether or not the reproduction process has ended (step S14). When the display control unit 84 determines that the reproduction has not ended (NO in step S14), the process returns to step S2, and the above processing is repeated.

On the other hand, when the display control unit 84 determines that the reproduction process has ended (YES in step S14), the process ends. On the other hand, if the selection unit 80 determines in step S20 that the time bar 224 has not been operated, it determines whether the work position image 232 has been operated. When selecting unit 80 determines that work position image 232 has not been operated (NO in step S20), the process proceeds to step S24.

On the other hand, when selecting unit 80 determines that work position image 232 has been operated (YES in step S20), it accepts a work position selection command (step S22). For example, the position selection command for the position of the work position image 232 is received at the position where the operation by the input unit 71 is completed. The work position image 232 is provided so that the position can be moved according to the trajectory of the movement trajectory image 234 .

Next, the selection unit 80 selects the work time corresponding to the position of the work position image 232 as the reproduction time (step S9). Subsequent processing is the same as described above, and detailed description thereof will not be repeated.

By selecting the position of the work position image 232 , the administrator can execute the motion image reproduction process at the reproduction position corresponding to the position of the work position image 232 . On the other hand, when the selection unit 80 determines that the work position image 232 has not been operated, it determines whether the event list has been operated.

When selecting unit 80 determines that the event list has not been operated (NO in step S24), the process returns to step S2. When selecting unit 80 determines that the event list has been operated (YES in step S24), it receives an event information selection command (step S26). For example, it is accepted as a selection command for event information designated by an operation through the input unit 71 . For example, a selection input of a time corresponding to excavation, overheating, or the like is accepted.

Next, the selection unit 80 selects the time at which the selection input is received as the playback time (step S9). Subsequent processing is the same as described above, and detailed description thereof will not be repeated. By manipulating the event list, the administrator can execute the motion image reproduction process at the reproduction position corresponding to the position of any event.

[Usage form]
The work screen 200 is displayed by the motion image processing of the second processing device 70 according to the embodiment. The work screen 200 displays, for example, an operation screen 210, a status screen 220, and a position screen 230, which are generated based on work machine operation data corresponding to work times during work of the wheel loader 1. FIG.

On the operation screen 210, a work state image 216 showing the work state of the wheel loader 1 is displayed as an example. An operation state image 221 is displayed on the state screen 220 as an example. On the position screen 230, a work position image 232 indicating the work position of the wheel loader 1 on the work map is displayed. The above screen enables the manager to easily grasp when, where, and what kind of work the operator of the wheel loader 1 performed.

Since the manager can easily recognize the operation state as well as the operation state of the wheel loader 1, it can be usefully used, for example, when instructing the operator to drive. By checking the operation state image 221 on the state screen 220 together with the operation screen 210, for example, the manager can provide appropriate guidance on the operation state of the operator corresponding to the operation state of the work machine. By checking the operation state image 221 on the state screen 220 together with the position screen 230, for example, the manager can provide appropriate guidance for the operator's operation state corresponding to the position state of the work machine.

Since the administrator can arbitrarily select the playback position of the motion image of the wheel loader 1, it can be usefully used, for example, when instructing the operator to drive. Also, by checking the event list, it can be used for troubleshooting, investigation of complaints, and the like.

[Other embodiments]
In the above embodiment, the working machine table is stored in the memory 73 of the second processing device 70, but is not limited to this. It's okay to be Based on the work machine table stored in the storage unit 30j of the first processing device 30, the above motion image processing may be executed.

In the above embodiment, the configuration in which various functional blocks are implemented in the CPU 75 of the second processing unit 70 has been described. can be

In the above embodiment, the case where the work screen 200 is displayed on the display section 72 of the second processing device 70 has been described, but the work screen 200 may be displayed on the display section 40 of the wheel loader 1 . Alternatively, the display unit 40 of the wheel loader 1 and the first processing device 30 may be integrated into one device. Further, the work screen 200 may be displayed not only on the wheel loader 1, but also on the display unit of a mobile terminal provided so as to communicate with the second processing device 70, for example.

In the above embodiment, a case has been described in which a plurality of screens synchronized with the work time are displayed on the work screen 200 . Specifically, although the operation screen 200 includes the operation screen 210, the status screen 220, the position screen 230, the event display screen 240, and the management screen 260 as a plurality of screens, all these screens are particularly displayed. For example, two or more screens may be displayed. For example, the operation screen 210 and the status screen 220 may be displayed on the work screen 200 . Other combinations of screens are of course possible.

[Effect]
Next, the effects of the embodiment will be described. As shown in FIG. 5, in the display system for the work machine of the embodiment, the second processing device 70 includes a communication unit 74 for receiving work machine operation information transmitted from the wheel loader 1, and a communication unit 74 for receiving the information. A motion image generation unit 82 for generating a motion image of the wheel loader 1 and an operation image corresponding to the motion image based on the work machine motion information obtained, and a display unit 72 for displaying the motion image and the operation image are provided. The work machine operation information includes operation information and operation information including vehicle information and position information as shown in FIG. An operation image of the wheel loader 1 and an operation image corresponding to the operation image are generated based on the operation information and the operation information, and the operation image and the operation image are displayed on the display unit 72 . Therefore, it is possible to easily recognize the operating state as well as the operating state of the wheel loader 1 .

The motion information and operation information may be acquired by the first processing device 30 or the second processing device 70 in the wheel loader 1 . Since it can be arranged not only in the first processing device in the wheel loader 1 but also in the second processing device which is another external device, it is possible to improve the flexibility of the display system.

The motion image generator 82 is provided in the first processing device 30 or the second processing device 70 in the wheel loader 1 . Since it can be arranged not only in the wheel loader 1 but also in other external equipment, it is possible to improve the flexibility of the display system of the work machine.

The display unit 72 is provided in the first processing device 30 or the second processing device 70 inside the wheel loader 1 . Since it can be arranged not only in the wheel loader 1 but also in other external equipment, it is possible to improve the flexibility of the display system of the work machine.

The display system for the work machine of the embodiment is provided with a memory 73 that stores the work machine operation information received by the communication unit 74 . The motion image generator 82 generates a motion image of the work machine based on the work machine motion information stored in the memory 73 as shown in FIG. An operation image corresponding to the operation image of the work machine is generated. By storing in the memory 73, it is possible to reproduce and process an operation image indicating the operation state of the wheel loader 1 and an operation image indicating the operation state. It is possible to make effective use of it when instructing the operator to drive.

The wheel loader 1 includes a work implement 3 and a travel device 4 . The work machine operation information shown in FIG. 6 includes vehicle information CN, and the vehicle information CN includes operation information of at least one of work implement 3 and travel device 4 . It is possible to easily recognize the operating state of at least one of the work implement 3 and the traveling device 4 of the wheel loader 1 and the operating state corresponding thereto.

The work machine operation information shown in FIG. 6 further includes identification information for identifying the operator or vehicle body. When a plurality of operators or a plurality of vehicle bodies are provided, it is possible to easily distinguish them from the identification information.

The wheel loader 1 is further provided with a selection unit 80 that selects the time of the working machine operation information as the reproduction time. The selection unit 80 sets the reproduction time of the work machine operation information according to the input command of the input unit 71 on the work screen 200 shown in FIG. Using the input interface of the work screen 200, it is possible to easily reproduce and confirm the operation state of the wheel loader 1. FIG.

Wheel loader 1 includes boom 14 and bucket 6 . The work machine operation information shown in FIG. 6 includes vehicle information CN, and the vehicle information CN includes a detection signal of second angle detection section 48 that detects the tilt angle of bucket 6 with respect to boom 14 . It is possible to easily recognize the state of the angle of the bucket 6 with respect to the boom 14 of the wheel loader 1 .

The work machine operation information shown in FIG. 6 includes operation information T, and the operation information T includes a detection signal of bucket operation detection section 54b. It is possible to easily recognize the operating state of the bucket 6 of the wheel loader 1 .

An example of the display system of the work machine of the embodiment is the display system of the wheel loader 1, and it is possible to easily recognize the operation state as well as the operation state of the wheel loader 1. FIG.

A method of controlling a display system for a work machine according to an embodiment includes steps of acquiring at least operation information and operation information of the work machine; and displaying the operation image and the operation image of the work machine. An operation image of the wheel loader 1 and an operation image corresponding to the operation image are generated based on the operation information and the operation information, and the operation image and the operation image are displayed on the display unit 72 . Therefore, it is possible to easily recognize the operation state as well as the operation state of the wheel loader 1 .

A wheel loader has been described as an example of a working machine, but the present invention can also be applied to working machines such as hydraulic excavators, dump trucks, and bulldozers.

Although the embodiments of the present invention have been described above, the embodiments disclosed this time should be considered to be illustrative in all respects and not restrictive. The scope of the present invention is indicated by the claims, and is intended to include all changes within the meaning and range of equivalents to the claims.

REFERENCE SIGNS LIST 1 wheel loader 2 body frame 3 working machine 4 travel device 5 cab 6 bucket 6a cutting edge 10 boom pin 13 steering cylinder 14 boom 15 tilt rod 16 boom cylinder 17 bucket pin 18 bell crank , 18a support pin, 19 tilt cylinder, 20 engine, 21 input shaft, 22 power take-off part, 23 power transmission mechanism, 23a output shaft, 24 cylinder drive part, 25 work machine pump, 26 control valve, 27 vehicle speed detection part, 28a 1st oil pressure detector 29 1st angle detector 30 first processing device 30j storage unit 31 temperature sensor 40, 72 display unit 45 output unit 48 second angle detector 49 forward/reverse switching device 49a forward/reverse switching operation member 49b forward/backward switching detection sensor 51 accelerator operation device 51a accelerator operation member 51b accelerator operation detection unit 52 boom operation device 52a boom operation member 52b boom operation detection unit 53 shift operation device , 53a gear shift operation member 53b gear shift operation detector 54 bucket operation device 54a bucket operation member 54b bucket operation detector 55 articulate operation device 55a articulate operation member 55b articulate operation detector 58 brake operation device, 58a brake operation member, 58b brake operation detection unit, 60 rotation mechanism, 61 articulated angle sensor, 64 position detection sensor, 70 second processing device, 71 input unit, 73 memory, 74 communication unit, 80 selection unit, 82 action image generation unit, 84 display control unit, 86 event generation unit, 88 event registration unit.

Claims (12)

an acquisition unit that acquires operation information including operation information of the work machine and operation of an accelerator ;
a motion image generation unit that generates a motion image of the work machine and an operation image related to the operation of the accelerator corresponding to the motion image of the work machine, based on the motion information and the operation information acquired by the acquisition unit;
a display unit that displays an operation image and an operation image of the work machine ;
The operation image related to the operation of the accelerator is
A display system for a working machine , comprising: an operation designation state image indicating a state in which operation of the accelerator is designated; and an operation transition state image indicating a transition state of the operation of the accelerator . 2. The display system for a working machine according to claim 1, wherein said acquisition unit is provided in either said working machine or an external device independent of said working machine. 3. The display system for a working machine according to claim 1, wherein said motion image generator is provided in either said working machine or an external device independent of said working machine. 4. The display system for a working machine according to claim 1, wherein said display unit is provided on either said working machine or an external device independent of said working machine. further comprising a storage unit that stores work machine operation information including the operation information and operation information of the work machine acquired by the acquisition unit;
The motion image generation unit
generating a motion image of the work machine based on the work machine motion information stored in the storage unit;
The display system for a work machine according to any one of claims 1 to 4, wherein an operation image corresponding to an operation image of said work machine is generated based on said work machine operation information stored in said storage unit. The working machine includes a working machine and a machine body,
The display system for a work machine according to any one of claims 1 to 5, wherein the operation information of said work machine includes operation information of at least one of said work machine and said machine main body. 6. The work machine display system of claim 5, wherein the work machine operational information further includes identification information. 6. The display system for a work machine according to claim 5, further comprising a selection unit that selects the time of the work machine operation information as the reproduction time. the work machine includes a boom and a bucket;
The display system for a work machine according to any one of claims 1 to 8, wherein the operation information of the work machine includes an angle of the bucket with respect to the boom. 10. The display system for a work machine according to claim 9, wherein the operation information of said work machine includes a detection signal of an operation command for said bucket. The work machine display system according to any one of claims 1 to 10, wherein the work machine is a wheel loader. a step of acquiring operation information including operation information of the work machine and operation of an accelerator ;
generating a motion image of the work machine and an operation image associated with the operation of the accelerator corresponding to the motion image of the work machine, based on the acquired motion information and operation information;
displaying a motion image and an operation image of the work machine ;
The operation image related to the operation of the accelerator is
A control method for a display system of a work machine , comprising an operation designation state image indicating a state in which the accelerator operation is designated, and an operation transition state image indicating a transition state of the accelerator operation .

Images