JP2022079813A - Medical care device and information processing system - Google Patents

Abstract

To provide a medical care device capable of improving workability when a medical care-giver performs a medical care using the medical care device.SOLUTION: A control device 61 executes control of a medical care device on the basis of a motion of a medical care-giver in an image acquired by a camera. Specifically, the control device 61 executes control of the medical care device on the basis of a specific motion of a predetermined part of a body of the medical care-giver, for example. More specifically, the control device 61 executes control to raise, for example, a support part 200 of an examination table 2 when, for example, the motion of the fingers of the medical care-giver in the image acquired by the camera is a motion that the thumb is turned up.SELECTED DRAWING: Figure 1

Description

The present invention relates to a medical device and an information processing system.

Patent Document 1 describes a step of obtaining one or more motion signals indicating the operation of an intraoral camera, a step of interpreting the obtained motion signal as an operator instruction corresponding to a predetermined motion pattern, and at least an image according to the operator instruction. Methods for obtaining intraoral images are disclosed, including steps to change the display of the content.

Japanese Patent Publication No. 2017-525411

It is common for a practitioner who provides medical care for dentistry to perform medical care using a medical device.
Here, when operating the medical device or changing the output of the medical device, the medical practitioner extends his arm to the switch and operates this switch, for example, to operate the medical device or for medical treatment. Change the output of the device. When the switch is operated in this way, the medical practitioner needs to take his / her eyes away from the part to be treated, and the workability tends to be deteriorated.
An object of the present invention is to improve workability when a medical practitioner performs medical treatment using a medical treatment device.

For this purpose, the medical device to which the present invention is applied includes an information acquisition means for acquiring information used for detecting the movement of the medical doctor without touching the medical doctor who performs medical treatment for dentistry, and the above-mentioned information acquisition means. A motion detecting means for detecting a specific motion of the medical doctor based on the information acquired by the information acquisition means, and a medical device used for the medical practice based on the specific motion detected by the motion detecting means. It is a medical device including a control means for controlling.

Here, the information acquisition means is configured by an imaging means for photographing the medical doctor, and the motion detecting means is characterized in that the image obtained by the imaging means is analyzed to detect the specific motion. Can be.
Further, the imaging means is an imaging means used for photographing the oral cavity of a patient to be treated, and the motion detecting means analyzes an image obtained by the imaging means for photographing the oral cavity to specify the above. It can be characterized by detecting the operation of.
Further, when the medical practitioner performs a predetermined motion, the imaging condition of the imaging means used for imaging the oral cavity is changed to an imaging condition suitable for imaging the specific motion. be able to.
Further, the motion detecting means detects a specific motion of the predetermined portion of the medical doctor, and the control means detects the specific motion of the predetermined portion detected by the motion detecting means. Based on the above, it can be characterized by controlling the medical device.
Further, a display device for displaying a part of the image obtained by the photographing means is further provided, and the specific operation is shown in a region of the images obtained by the photographing means that is not displayed on the display device. Even if there is, it can be characterized in that the control based on the specific operation is performed by the control means.
Further, the control means is characterized in that when the medical doctor performs a predetermined operation, the control means controls the medical device based on the specific operation detected by the motion detecting means. Can be done.
Further, the control means is characterized in that when the specific operation detected by the operation detection means is performed at a predetermined location, the control means controls the medical device based on the specific operation. can do.
Further, the control means is based on the specific motion when the specific motion detected by the motion detecting means is performed at a location exceeding a predetermined distance from the patient's body. It can be characterized in that the medical equipment is controlled and the medical equipment is not controlled when the specific operation is performed at a place not exceeding the predetermined distance.
Further, when the specific operation detected by the operation detecting means is performed at the first location and when the specific operation is performed at a second location different from the first location. It can be characterized in that the control contents by the control means are different.
Further, when the specific motion detected by the motion detecting means is performed at a location exceeding a predetermined distance from the patient's body, the specific motion is predetermined. It can be characterized in that the control content by the control means differs depending on whether the control is performed at a location that does not exceed the distance.
Further, when the control means starts the operation of the medical device based on the specific operation detected by the motion detecting means, or when the medical device is in a predetermined state, the medical treatment is performed. It can be characterized by initiating the operation of the equipment.
Further, the control means can be characterized in that when the medical device is inside the oral cavity of the patient, the operation of the medical device is started.
Further, the control means can be characterized in that when the medical device is located outside the oral cavity of the patient, the operation of the medical device is started.
Further, the control means can be characterized in that the medical equipment is controlled based on the specific movements of the plurality of places of the medical doctor detected by the motion detecting means.

Further, when the present invention is regarded as an information processing system, the information processing system to which the present invention is applied acquires information used for detecting the movement of a medical doctor who performs medical treatment for dentistry without touching the medical doctor. Control of a motion detecting means for detecting a specific motion of the medical doctor based on the information acquired by the information acquisition means and a medical device used for the medical practice based on the specific motion detected by the motion detecting means. It is an information processing system provided with a determination means for determining the contents of the above.

According to the present invention, it is possible to improve workability when a medical practitioner performs medical treatment using a medical treatment device.

It is a figure which showed the medical equipment for dentistry used for the medical treatment of dentistry. It is a front view of a dental lighting device. It is a figure which showed the hardware structure of a control device. It is a figure which showed the functional part realized by the control device of a medical apparatus. It is a figure which showed the correspondence table. (A) and (B) are diagrams showing an example of the movement of a medical doctor. It is a figure explaining the image obtained by a camera. It is a figure which showed another example of the correspondence table. It is sectional drawing of the support part in the IX-IX line of FIG.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.
FIG. 1 is a diagram showing a dental medical equipment 100 used for dental medical treatment.
In the medical device 100 shown in FIG. 1, a dental medical table 2 that supports the patient from below is provided on the floor surface. The medical table 2 is provided with a support portion 200 that supports the patient from below and an elevating mechanism 250 that raises and lowers the support portion 200.
The elevating mechanism 250 is provided with a drive source (not shown) such as a motor, and the support portion 200 moves up and down when the drive source is driven.

The support portion 200 is provided with a seat plate 2b. Further, the clinic table 2 is provided with a backrest 2c. One end of the backrest 2c is attached to the seat plate 2b, and the backrest 2c rotates around this one end.
Further, the clinic table 2 is provided with a headrest 2d that is attached to the backrest 2c and supports the patient's head.
Further, the clinic table 2 is provided with a leg support portion 2e that supports the leg portion of the patient.

In the present embodiment, the surface of the seat plate 2b is a support surface 2f that supports the buttocks of the patient, and the patient first sits on the seat plate 2b at the time of medical treatment.
At this time (when the patient sits down), the backrest 2c is in a standing state (raised state), which is different from the state shown in FIG. Further, when the patient sits down, the leg support portion 2e is in a hanging state unlike the state shown in FIG. 1.
After that, in the present embodiment, the seat plate 2b rises and the back plate 2c falls further. Further, the leg support portion 2e rotates about one end portion 2g, and the other end portion 2h of the leg portion support portion 2e rises.

Further, the medical device 100 is provided with a display device 300 for displaying an image. The display device 300 is composed of, for example, a liquid crystal display.
The display device 300 is fixed to the wall (not shown) of the room in which the medical device 100 is installed. The display device 300 is not limited to being fixed to the wall, but may be attached to a member such as a tray table 3 that constitutes a part of the medical device 100.
Further, in the present embodiment, a foot controller 400 operated by the feet of a medical doctor such as a dentist is provided.

Further, in the medical device 100, a tray table 3 for doctors is provided beside the medical table 2, and an instrument holder 10 for doctors is further provided. Further, an instrument holder 4 for an assistant is provided on the opposite side of the tray table 3 across the clinic table 2.
Further, a movable support arm 13 is provided, and the tray table 3 and the instrument holder 10 are supported by the support arm 13. As a result, the tray table 3 and the instrument holder 10 can be moved in the horizontal direction.
Further, the medical device 100 is provided with a dental lighting device 90 that irradiates the oral cavity of the patient with light, an arm 6b that supports the dental lighting device 90, and a support column 6c that supports the arm 6b.

FIG. 2 is a front view of the dental lighting device 90.
The dental lighting device 90 is provided with a light source 90A. Further, the dental lighting device 90 is provided with a camera 91 in addition to the light source 90A.
This camera 91 as an example of information acquisition means and imaging means is configured to include an image pickup device such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor), and photographs the oral cavity of a patient to be treated. do.

The instrument holder 10 for the doctor (see FIG. 1) and the instrument holder 4 for the assistant hold the therapeutic instrument 11 as an example of the medical device so that it can be freely inserted and removed (in FIG. 1, for the assistant). Only the therapeutic instrument 11 of the above is shown).
Examples of the therapeutic instrument 11 for a doctor include an air turbine handpiece, a micromotor handpiece, a scaler, a three-way syringe, a root canal length measuring device, a root canal magnifying device, and an intraoral camera.
Further, as the therapeutic device 11 for the assistant, for example, a suction device 20 for sucking saliva, blood, cutting debris, etc. (hereinafter, may be referred to as “waste liquid”) in the oral cavity of the patient can be mentioned. ..

In FIG. 1, the instrument holder 4 holds the suction syringe (vacuum syringe) 21 and the saliva ejector 22 as an example of the suction device 20.
Each of the suction devices 20 is connected to an intake source (described later) (not shown) such as a vacuum pump or a compressor, and the suction is performed by the intake source to suck the waste liquid.

Further, on the side (periphery) of the clinic table 2, a supply device 5 for supplying water to a cup (not shown) used by the patient for gargling is provided.
The supply device 5 includes a waste liquid receiving unit 52 that receives the waste liquid discharged from the patient's oral cavity, a cup water supply unit 53 that supplies water to the cup, and a cleaning water supply unit that supplies cleaning water to the waste liquid receiving unit 52. A portion 54 is provided.

Further, the supply device 5 is provided with a storage container (suction tank) 60 for accommodating the waste liquid inside the supply device 5.
The storage container 60 contains the waste liquid (waste liquid sucked from the patient's oral cavity) sucked by the suction device 20 (suction syringe 21, saliva ejector 22, etc.).
Further, inside the supply device 5, a control device 61 for controlling each part of the medical care device 100 is provided.

FIG. 3 is a diagram showing the hardware configuration of the control device 61.
The control device 61 provided in the medical device 100 is composed of a computer and includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, and a RAM (Random Access Memory) 103. Further, the information storage device 104 configured by a hard disk device or the like is provided.

The ROM 102 stores a program executed by the CPU 101. The CPU 101 reads out the program stored in the ROM 102, sets the RAM 103 as a work area, and executes the program.
The program executed by the CPU 101 is stored in a computer-readable recording medium such as a magnetic recording medium (magnetic tape, magnetic disk, etc.), an optical recording medium (optical disk, etc.), an optical magnetic recording medium, or a semiconductor memory. It can be provided to the medical device 100.
Further, the program executed by the CPU 101 may be downloaded to the medical device 100 by using a communication means such as the Internet.

In this embodiment, a case where various processes for the medical device 100 are performed by the control device 61 provided in the medical device 100 will be described.
In the present embodiment, the portion provided with the control device 61 functions as an information processing system that processes information about the medical device 100, and the information processing system controls the medical device 100.

Not limited to this, some or all of the various processes of the medical device 100 may be performed by an external device such as a server device provided separately from the medical device 100. In other words, some or all of the various processes of the medical device 100 may be performed by an external information processing system provided separately from the medical device 100.
Further, when the processing is performed by an external information processing system, the processing may be performed by one information processing device, or the processing may be distributed by using a plurality of information processing devices.

FIG. 4 is a diagram showing a functional unit realized by the control device 61. Note that FIG. 4 shows only the functional units related to the control of the medical device.
The control device 61 controls various medical equipment used for medical treatment based on the movement of the medical person shown in the image (moving image) obtained by the camera 91, which is an example of the photographing means.
The camera 91 is an example of an information acquisition means for acquiring information used for detecting the movement of the medical doctor without touching the medical doctor. The camera 91 acquires a video (moving image) showing a medical doctor performing various movements as information used for detecting the movement of the medical doctor without touching the medical doctor.

In the present embodiment, the case where the camera 91 is used as the information acquisition means will be described as an example, but the information acquisition means is not limited to the camera 91.
As an example of the information acquisition means, for example, a device that emits infrared rays or millimeter wave radar to a medical doctor and further receives reflected waves from the medical doctor or passing waves that have passed through the medical doctor. Be done.
When this device is used, the reflected wave and the passing wave differ depending on the movement of the doctor, and by analyzing the reflected wave and the passing wave, the movement performed by the doctor can be detected.

The camera 91 and the device using the infrared ray or the millimeter wave radar acquire the information used for detecting the movement of the medical doctor by using the electromagnetic wave such as the light, the infrared ray, and the millimeter wave radar.
Specifically, the camera 91 detects an electromagnetic wave (reflected light) from the medical doctor and acquires information used for detecting the movement of the medical doctor.
In addition, devices that use infrared or millimeter-wave radar detect electromagnetic waves reflected from the doctor (reflected waves) and electromagnetic waves that have passed through the doctor (passing waves), and use information to detect the movements of the doctor. get.

In addition, as an information acquisition means, a device using other than electromagnetic waves such as a sound wave can be mentioned as an example.
Even when using sound waves, the reflected waves from the clinician and the passing waves that have passed through the clinician differ depending on the movement of the clinician, and by detecting these reflected waves and passing waves, the clinician's movements. Information used for detection of can be acquired.

The medical equipment to be controlled by the control device 61 includes not only the above-mentioned therapeutic instrument 11 directly used for treating the patient's teeth, but also a medical table 2, a dental lighting device 90, a supply device 5, and the like. ..
The control device 61 is a treatment instrument 11, a clinic table 2, a dental lighting device 90, and a supply device based on the movement of the doctor shown in the image obtained by the camera 91, the reflected wave, the transmitted wave, and the like. 5 and the like are controlled.
In the following description, a case where the control device 61 performs control based on the operation of the medical doctor shown in the image obtained by the camera 91 will be described.

The control device 61 functions as an operation detection unit 111, a control content determination unit 112, and an equipment control unit 113.
In the present embodiment, the CPU 101 reads out the program stored in the ROM 102 and executes the program using the RAM 103 as a work area to realize these functional units.

The motion detection unit 111 as an example of the motion detection means detects a specific motion of the medical doctor.
More specifically, the motion detection unit 111 detects a specific motion of the clinician based on the information used for detecting the motion of the clinician acquired by the camera 91 which is an example of the information acquisition means. More specifically, the motion detection unit 111 detects a specific motion of the medical doctor based on the image (moving image) acquired by the camera 91.
More specifically, the motion detection unit 111 analyzes a video (moving image) obtained by the camera 91 that obtains information about the clinician, and detects a specific motion of the clinician.

Here, the motion detection unit 111 detects a specific motion of the medical doctor by using the existing technique. Specifically, the motion detection unit 111 detects a specific motion of the medical doctor by using an algorithm used in, for example, PoseNet or Kinect.
More specifically, the motion detection unit 111 determines whether or not the information included in the image acquired by the camera 91 includes information representing a specific motion, and when this information is included. , Detects a specific action of the practitioner.
When the reflected wave or the passing wave is obtained as described above, the motion detecting unit 111 determines whether or not the reflected wave or the passing wave contains information representing a specific motion, and this information. Detects a specific behavior if it is included.

When the motion detection unit 111 detects a specific motion of the clinician, the control content determination unit 112 and the device control unit 113, which are examples of the control means, detect the specific motion of the clinician by the motion detection unit 111. Controls the medical equipment used for medical treatment based on.
Specifically, when the motion detection unit 111 detects a specific motion of the medical doctor, first, the control content determination unit 112 that functions as a determination means controls based on the specific motion detected by the motion detection unit 111. The target medical equipment is specified, and the content of control of the specified medical equipment is determined.

More specifically, in the present embodiment, as shown in FIG. 5 (a diagram showing a correspondence table), the content of the specific operation of the medical doctor, the medical equipment to be controlled, and the medical equipment. A correspondence table in which the control contents are associated with each other is generated in advance, and this correspondence table is stored in the information storage device 104 (see FIG. 3) in advance.
When the control content determination unit 112 obtains information about a specific operation detected by the operation detection unit 111, the control content determination unit 112 refers to this correspondence table to specify a medical device to be controlled, and further, the medical device. The control content of the medical device is grasped, and the grasped control content is determined as the control content of the medical device.

Next, in the present embodiment, the device control unit 113 generates a control signal based on the control content determined by the control content determination unit 112, and the control signal is used as the medical device specified by the control content determination unit 112. Output to.
Thereby, in the present embodiment, the medical device associated with this specific operation operates with the control content associated with this specific operation according to the specific operation of the medical doctor.

In this embodiment, the camera 91 takes a picture of the patient's oral cavity as well as the clinician. "Practitioner" includes not only dentists but also non-dentists such as dental hygienists.
Then, in the present embodiment, as described above, the control device 61 controls the medical equipment used for medical treatment based on the specific operation of the medical doctor shown in the image obtained by the camera 91.
In the present embodiment, the medical practitioner performs a predetermined specific operation (gesture) when the medical device is operated or the output of the medical device is changed. Thereby, in the present embodiment, the medical device is controlled according to the predetermined specific operation.

In the present embodiment, the camera 91 that photographs the oral cavity of the patient is used to acquire information about the movement of the doctor. As described above, when the camera 91 for photographing the oral cavity is used, it is not necessary to install a dedicated camera for photographing the movement of the medical doctor, and the cost can be reduced.
In addition, it does not exclude the installation of a dedicated camera for shooting the movement, but a dedicated camera for shooting the movement of the doctor is installed, and this dedicated camera is used to shoot the movement of the doctor. You may go.

As described above, the control device 61 controls the medical equipment based on the movement of the medical doctor shown in the image obtained by the camera 91.
More specifically, the control device 61 controls the medical device based on, for example, a specific movement of a predetermined part of the body of the medical doctor. More specifically, the control device 61 controls the medical device based on, for example, a specific movement of the medical doctor's fingers.
More specifically, in the present embodiment, the motion detection unit 111 detects a specific motion of a predetermined portion of the medical doctor. Then, in the present embodiment, the medical device is controlled based on the specific movement of the predetermined portion.

More specifically, in the control device 61, for example, the movement of the thumb of the doctor, which is reflected in the image obtained by the camera 91, is, for example, FIG. 6 (a diagram showing an example of the movement of the doctor). As shown in (A), in the case of the movement of pointing the thumb upward, for example, the support portion 200 (see FIG. 1) of the clinic table 2 is controlled to be raised.
Further, in the control device 61, for example, when the movement of the finger of the medical doctor shown in the image obtained by the camera 91 is, for example, as shown in FIG. 6B, the movement of the thumb is directed downward. , The support portion 200 (see FIG. 1) of the clinic table 2 is controlled to be lowered.
More specifically, in this case, a control signal is output from the device control unit 113 of the control device 61 to the elevating mechanism 250 (see FIG. 1) provided in the clinic table 2, and the clinic table 2 is raised or lowered. do.

Here, the case where the medical table 2 is raised or lowered has been described as an example, but other control contents of the medical device include, for example, a backrest 2c provided on the medical table 2 (FIG. FIG. 1) can be mentioned as a process of defeating or standing up.
In addition, as the content of control of the medical device, for example, on / off control of the therapeutic instrument 11 (control to start or stop the operation) and control to increase or decrease the output of the therapeutic instrument 11 Can be mentioned.
Here, examples of the control for increasing or decreasing the output of the therapeutic instrument 11 include a process of increasing or decreasing the rotation speed of the air turbine handpiece and the micromotor handpiece as an example of the therapeutic instrument 11.

In addition, as the content of control of the medical equipment, for example, on / off control of the dental lighting device 90 and control of increasing / decreasing the output (brightness) of the dental lighting device 90 can be mentioned.
Further, here, the case where the medical device is controlled based on the movement (orientation) of the thumb of the medical doctor has been described as an example, but the medical device is controlled based on the movement of another finger such as the index finger. You may. Further, the medical device may be controlled based on the direction of the palm or the back of the hand.

In addition, here, the finger of the medical doctor is given as an example as the "predetermined part of the medical doctor", but the arm of the medical doctor is also used as the "predetermined part of the medical doctor". The legs of the doctor, the face of the doctor, and the head of the doctor can be mentioned.
For example, when the medical doctor raises the elbow or raises one leg, the medical device may be controlled. Further, for example, when the medical doctor changes his / her facial expression such as closing one eye or opening his / her mouth, he / she may control the medical equipment. In addition, for example, when the medical doctor performs an operation such as tilting the head, the medical equipment may be controlled.

When the medical equipment is controlled based on the specific movement of the medical doctor shown in the image obtained by the camera 91 as in the present embodiment, the medical staff does not touch the physical switch. You can control the target medical equipment.
Further, when the medical equipment is controlled based on the specific movement of the medical person shown in the image obtained by the camera 91, the medical person keeps an eye on the affected part of the patient and controls the medical equipment. Can be done.

FIG. 7 is a diagram illustrating an image obtained by the camera 91.
In the present embodiment, the range indicated by the reference numeral 7A is the angle of view of the camera 91, and in the present embodiment, an image of an image to be photographed within the range of this angle of view is acquired.
In the present embodiment, not all the shooting targets within the range of the angle of view are displayed on the display device 300 (see FIG. 1), but a part of the shooting target is displayed on the display device 300.
Specifically, in the present embodiment, the image of the photographing object located in the area indicated by the reference numeral 7B is displayed on the display device 300, and the image of the photographing object existing in the area indicated by the reference numeral 7C is displayed on the display device. It is configured not to be displayed in 300.

In the present embodiment, even if a specific operation of the medical doctor is shown in the image obtained by the camera 91 that is not displayed on the display device 300, the operation detection unit 111 performs this specific operation. Is detected.
Then, control based on this specific operation is performed by the control content determination unit 112 and the device control unit 113 as an example of the control means.
More specifically, even when a specific operation of the medical doctor is performed in the region indicated by reference numeral 7C, the control based on this specific operation is performed by the control content determination unit 112 and the device control unit 113. Will be done.

As a result, in the present embodiment, the medical practitioner performs a specific operation in a region not reflected on the display device 300, so that the image of the oral cavity displayed on the display device 300 is displayed by the image of the specific operation. It is suppressed that it becomes difficult to see.
In the present embodiment, when the medical practitioner performs a specific operation in the area reflected on the display device 300, the oral cavity of the patient is positioned behind the specific operation, and the oral cavity becomes difficult to see.
On the other hand, when the medical practitioner performs a specific operation in a region not reflected on the display device 300, the specific operation is performed at a position off the line connecting the oral cavity and the camera 91. .. In this case, the image of the oral cavity displayed on the display device 300 is less likely to be obscured by the image of this specific operation.

(Other processing examples)
The control device 61 does not uniformly control the medical equipment based on the specific operation shown in the image, but the control device 61 is reflected in the image when the medical doctor performs a predetermined operation. The medical device may be controlled based on a specific operation.
In other words, the control of the medical device based on the specific motion detected by the motion detecting unit 111 may be performed when the medical practitioner performs a predetermined motion.

More specifically, the control device 61 performs a predetermined operation such as an operation on the foot controller 400 (see FIG. 1) by the medical doctor, and then a specific operation for controlling the medical equipment (see FIG. 1). When the motion detection unit 111 performs a specific motion to be detected), the medical device may be controlled.
Thereby, in this case, the medical equipment is controlled on condition that the medical doctor steps on the foot controller 400, for example.
More specifically, on condition that the medical doctor steps on the foot controller 400, for example, the operation of the medical device is started or the output of the medical device is changed.

In this case, the medical practitioner cannot control the medical device based on his / her specific motion (the specific motion to be detected by the motion detection unit 111) unless he / she steps on the foot controller 400.
In this case, the unintended medical equipment is controlled as compared with the case where the medical equipment is controlled based only on the specific operation performed in front of the camera 91 (the specific operation to be detected by the motion detection unit 111). Operation and output changes are less likely to occur.

In other words, in this processing example, the medical practitioner needs not only to perform a specific operation for controlling the medical device in front of the camera 91, but also to perform an operation different from this specific operation.
In this case, as compared with the case where the medical device is controlled based only on this specific operation, the unintended operation of the medical device or the unintended output of the medical device due to false detection of the specific operation or the like is performed. Changes are less likely to occur.

The control device 61 determines whether or not the foot controller 400 has been operated by a medical doctor, for example, based on the output from the foot controller 400. Further, the control device 61 may determine whether or not the foot controller 400 has been operated by a medical doctor by analyzing the image obtained by the camera 91.

Further, in the present embodiment, the operation with respect to the foot controller 400 is given as an example as the above-mentioned "another operation", but in addition, for example, an operation in which a medical doctor emits a predetermined voice or a predetermined operation is predetermined. An operation of operating a switch is also given as an example of this "another operation".
In addition, for example, an action in which a medical doctor moves a part of his / her body is also mentioned as an example of "another action".

Here, whether or not the medical doctor has performed an operation of emitting a predetermined voice is determined in advance by, for example, installing a microphone in the medical device 100, and based on the output from the microphone. Determine if you have performed an action that emits voice.
In addition, whether or not the clinician has performed an operation to operate a predetermined switch is determined, for example, by obtaining an output from this switch, and when there is a predetermined output from the switch, the clinician decides. , Judge that the operation to operate the switch has been performed. In addition, the image obtained by the camera 91 may be analyzed to determine whether or not the doctor has performed an operation to operate the switch.
Further, regarding whether or not the medical doctor has performed an action of moving a part of his / her body, for example, by analyzing the image obtained by the camera 91, it can be determined whether or not the action of moving this part has been performed. to decide.

(Other processing examples)
In addition, the control device 61 may control the medical device based on this specific operation when the specific operation shown in the image is performed at a predetermined specific place.
In other words, the control device 61 may start the control associated with this specific operation when the specific operation shown in the image is performed at a predetermined specific place. ..
More specifically, when the motion detection unit 111 detects a specific motion, and the motion detection unit 111 determines that the specific motion is performed at a predetermined specific location, this specific motion is specified. Control of the medical device based on the operation may be started.

More specifically, for example, the control device 61 may perform this specific motion when the specific motion shown in the image is performed at a location exceeding a predetermined distance from the patient's body. Controls medical equipment based on this.
More specifically, the control device 61 associates a specific motion shown in the image with the specific motion when the specific motion is performed at a location exceeding a predetermined distance from the patient's body. It controls to start the operation of the medical device and to increase the output of the medical device.

On the other hand, the control device 61 performs a process of not controlling the medical device when the specific operation shown in the image is performed at a place where the predetermined distance is not exceeded.
Specifically, in this case, the control device 61 performs this specific operation, for example, when the specific operation shown in the image does not exceed a predetermined distance from the patient's body. Do not start the operation of the associated medical device or increase the output of this medical device.

More specifically, when performing this process, first, the motion detection unit 111 of the control device 61 analyzes the image obtained by the camera 91 to detect a specific motion performed by the medical doctor. Further, the motion detection unit 111 analyzes the image and grasps the distance between the portion where the specific motion is performed and the portion of the patient's body closest to the portion where the specific motion is performed.
Then, if this distance grasped by the motion detection unit 111 does not exceed a predetermined distance, the device control unit 113 does not start the operation of the medical device associated with this specific motion. Alternatively, control is performed so as not to increase the output of this medical device.
The distance between the location where the specific movement is performed and a predetermined reference such as the patient's body may be grasped by using a known video analysis technique.

Here, for example, when the specific movement performed by the medical doctor is the movement of the finger, the medical doctor may move the finger while holding the therapeutic instrument 11 in his / her hand.
In this case, this operation of moving the fingers is performed near the patient's body, and for example, the content of the control performed based on this operation of moving the fingers is a control for raising the support portion 200 (see FIG. 1). If this is the case, a situation may occur in which the therapeutic instrument 11 touches the patient.
On the other hand, as in the present embodiment, when the specific operation shown in the image is performed at a place farther than a predetermined distance from the patient's body, the control of the medical device is controlled. When this is done, the situation where the therapeutic instrument 11 touches the patient is less likely to occur.

(Other processing examples)
In addition, there are cases where the specific operation shown in the image is performed at the first location and cases where the specific operation is performed at a second location different from the first location. Therefore, the content of the control performed based on this specific operation may be different.
More specifically, there are cases where the motion detection unit 111 detects a specific motion and determines that the specific motion is performed at the first location, and the motion detection unit 111 detects the specific motion and this. The content of the control performed based on this specific operation may be different depending on the case where it is determined that the specific operation is performed at the second place different from the first place.

When this process is performed, as shown in FIG. 8 (a diagram showing another example of the corresponding table), the content of the specific operation, the place where the specific operation is performed, and the medical treatment to be controlled. After associating the device with the control content in advance, these information are registered in the corresponding table.
The control device 61 refers to this correspondence table, and depending on the location where the specific operation shown in the image is performed, the content of the control performed based on this specific operation (medical equipment to be controlled, and the medical equipment to be controlled). , Control content) is determined.

Specifically, for example, as shown in FIG. 9 (cross-sectional view of the support portion 200 on the IX-IX line in FIG. 1), a specific motion shown in the image (a specific motion detected by the motion detection unit 111). ) Was performed at a location exceeding a predetermined distance L from the patient's body, and this specific action was performed at a location not exceeding this predetermined distance L. The content of the control performed based on this specific operation is different depending on the case.

More specifically, for example, when a medical doctor performs a specific operation for raising the support portion 200, and this specific operation is performed at a place where the above-mentioned distance L is not exceeded. In this case, control is performed to reduce the ascending speed of the support portion 200.
Further, for example, conversely, when this specific operation is performed at a location exceeding the above distance L, control is performed to increase the ascending speed of the support portion 200.

Similar to the above, for example, it is assumed that a medical doctor performs a specific action of moving his / her finger while holding the therapeutic instrument 11 in his / her hand.
In this case, if this particular action of moving the finger is performed near the patient's body and, for example, the control based on this particular action of moving the finger is a control that raises the support 200, it is therapeutic. Events such as contact of the instrument 11 with the patient may occur.

In such a case, in the present embodiment, the ascending speed of the support portion 200 becomes small, and even if the therapeutic instrument 11 comes into contact with the patient, its influence becomes small.
On the other hand, in the present embodiment, when the specific action of moving the fingers is performed at a location exceeding the above distance L (when performed at a location away from the patient's body), the support portion. The 200 rises at a faster rate.
In this case, the support portion 200 can be raised more quickly while suppressing the occurrence of a situation such as the therapeutic instrument 11 touching the patient.

(Other processing)
In addition, when the control device 61 starts the operation of the medical device based on the specific operation (specific operation detected by the motion detection unit 111) shown in the image, the medical device is preliminarily used. The operation of this medical device may be started when it is in a predetermined state.
In other words, the control device 61 indicates that the specific operation shown in the image is an operation instructing to start the operation of the medical device, or when the medical device is in a predetermined state. The operation of this medical device may be started.

More specifically, when the control device 61 is, for example, an operation instructing that the specific operation shown in the image starts the operation of the therapeutic instrument 11, the therapeutic instrument 11 is the patient's oral cavity. When it is in the state of being inside the treatment device 11, the operation of the therapeutic device 11 is started.
More specifically, when the specific operation shown in the image is, for example, an operation instructing the treatment instrument 11 used for cutting the patient's teeth to be operated, the control device 61 is used for this treatment. When a part (tip) of the instrument 11 is inside the patient's oral cavity, the operation of the therapeutic instrument 11 is started.
Here, the state in which the therapeutic instrument 11 is inside the patient's oral cavity is not limited to the state in which all parts of the therapeutic instrument 11 are inside the patient's oral cavity, and a part of the therapeutic instrument 11 is not limited to the state where the therapeutic instrument 11 is inside the patient's oral cavity. It also includes the condition inside the patient's oral cavity. On the other hand, the control device 61 prevents the therapeutic instrument 11 from starting operation when the therapeutic instrument 11 is not in the patient's oral cavity.

More specifically, in this case, the control content determination unit 112 analyzes the image obtained by the camera 91 and determines whether or not the therapeutic instrument 11 is in the oral cavity of the patient. Then, when the control content determination unit 112 determines that the therapeutic instrument 11 is in the oral cavity of the patient, the control content determining unit 112 makes a determination to start the operation of the therapeutic instrument 11.
On the other hand, the control content determination unit 112 determines that the operation of the therapeutic instrument 11 is not started when it is determined that the therapeutic instrument 11 is not in the patient's oral cavity. In this case, the device control unit 113 does not start the operation of the therapeutic device 11.

As a result, in this treatment example, it is prevented that the operation of the therapeutic instrument 11 is started in a state where the therapeutic instrument 11 is not contained in the oral cavity of the patient.
Here, the therapeutic instrument 11 is in a state where the therapeutic instrument 11 (specifically, the therapeutic instrument 11 used for cutting the patient's teeth) is not contained in the patient's oral cavity (the state outside the oral cavity). When the operation is initiated, the operating device 11 will be placed in the patient's oral cavity. In this case, the operating device 11 may touch the patient's lips and the like, which is not preferable.
On the other hand, when the therapeutic instrument 11 is inside the patient's oral cavity and the operation of the therapeutic instrument 11 is started, the operating instrument 11 touches the patient's lips and the like. Things are less likely to happen.

In addition, when the control device 61 is, for example, an operation instructing that the specific operation shown in the image starts the operation of the therapeutic instrument 11, the therapeutic instrument 11 is in the oral cavity of the patient. The treatment device 11 may be started to operate when it is in an external state.
More specifically, the control device 61 is, for example, a case where the specific operation shown in the image is an operation instructing the operation of the treatment instrument 11 other than the treatment instrument 11 used for cutting the tooth. When the therapeutic instrument 11 is in a state outside the patient's oral cavity, the operation of the therapeutic instrument 11 is started.
On the other hand, the control device 61 prevents the therapeutic instrument 11 from starting operation when it is in the patient's oral cavity.

Here, a case where it is determined whether or not the therapeutic instrument 11 is contained in the oral cavity of the patient by analyzing the image obtained by the camera 91 has been described as an example. In other words, here, a case where it is determined whether or not a medical device such as a therapeutic device 11 is in a predetermined state by analyzing an image obtained by the camera 91 has been described as an example.
By the way, not limited to this, whether or not the medical device is in a predetermined state may be determined based on the output from the medical device.

(Other processing)
Further, the control device 61 is for medical treatment based on the specific movements of the plurality of places of the doctor shown in the image (based on the specific movements of the plurality of places of the doctor detected by the motion detection unit 111). You may control the device.
Specifically, the control device 61 may control the medical device based on, for example, a specific movement of the right hand and a specific movement of the left hand of the medical doctor.

More specifically, the control device 61 controls to raise the support portion 200 when, for example, the thumb of the right hand of the medical doctor points upward and the thumb of the left hand points upward.
In addition to this, for example, the control device 61 controls to increase the rotation speed of the therapeutic instrument 11 when the thumb of the right hand of the medical doctor points upward and the thumb of the left hand points upward. ..
As a result, the intention of the medical device due to erroneous detection of a specific movement, etc., as compared with the case where the medical device is controlled based only on the specific movement of one part of the medical doctor shown in the image. It is less likely that the operation will not be performed or that the output of the medical equipment will be changed unintentionally.

Here, as an example of a combination of a plurality of places, the right hand and the left hand of a medical doctor are given as an example, but the combination of a plurality of places is not limited to this.
Other combinations of the plurality of locations include, for example, hand-to-foot, hand-to-face facial expression, foot-to-face facial expression, right foot and left foot, and the like.

(Other processing)
In addition, the control device 61 changes the shooting conditions of the camera 91 to shooting conditions suitable for shooting a specific movement of the doctor, for example, when the doctor performs a predetermined operation. May be good.
Specifically, for example, in the control device 61, the medical doctor operates the foot controller 400 (see FIG. 1), performs predetermined finger movements, “changes the imaging conditions”, and the like. When the voice instruction is given, the shooting condition of the camera 91 is changed to a shooting condition suitable for shooting a specific motion of the medical doctor.

Here, the above-mentioned "predetermined operation" for changing the shooting conditions is not limited to the operation in which the image is acquired by the camera 91.
As described above, this "predetermined operation" may be an operation other than the operation of acquiring the image by the camera 91, such as an operation on the foot controller 400 or an instruction by voice.

The control device 61 increases the resolution of the camera 91 or moves the lens inside the camera 91 as a control for changing the shooting conditions suitable for shooting a specific motion of the medical doctor. Controls to widen the angle of view of the camera.
As a result, the imaging conditions of the camera 91 become conditions suitable for imaging a specific motion of the medical doctor.
In other words, if the imaging conditions are changed, even when the camera 91 for imaging the oral cavity is used as in the present embodiment, the imaging conditions of the camera 91 are suitable for imaging a specific motion of the medical doctor. Can be a condition.

2 ... Clinic table, 5 ... Supply device, 11 ... Treatment instrument, 61 ... Control device, 90 ... Dental lighting device, 91 ... Camera, 100 ... Medical device, 111 ... Motion detection unit, 112 ... Control content determination unit , 113 ... Equipment control unit, 300 ... Display device

Claims (16)

Information acquisition means for acquiring information used to detect the movement of the clinician without touching the clinician who provides medical treatment for dentistry.
An motion detecting means for detecting a specific motion of the medical doctor based on the information acquired by the information acquiring means, and an motion detecting means.
A control means for controlling a medical device used for the medical treatment based on the specific operation detected by the motion detecting means, and a control means for controlling the medical equipment used for the medical treatment.
A medical device equipped with. The information acquisition means is composed of an imaging means for photographing the medical doctor.
The medical device according to claim 1, wherein the motion detecting means analyzes an image obtained by the photographing means to detect the specific motion. The imaging means is an imaging means used for photographing the oral cavity of a patient to be treated.
The medical device according to claim 2, wherein the motion detecting means analyzes an image obtained by the photographing means for photographing the oral cavity and detects the specific motion. The medical treatment according to claim 3, wherein when the medical doctor performs a predetermined operation, the imaging conditions of the imaging means used for imaging the oral cavity are changed to imaging conditions suitable for imaging the specific motion. Equipment. The motion detecting means detects a specific motion of a predetermined portion of the clinician and detects the motion.
The medical device according to claim 1, wherein the control means controls the medical device based on the specific movement of the predetermined portion detected by the motion detecting means. A display device for displaying a part of the image obtained by the photographing means is further provided.
2. Claim 2 in which control based on the specific operation is performed by the control means even when the specific operation is displayed in an area of the image obtained by the photographing means that is not displayed on the display device. The medical device described in. The medical treatment according to claim 1, wherein the control means controls the medical device based on the specific operation detected by the motion detection means when the medical practitioner performs a predetermined motion. Device. The first aspect of claim 1, wherein the control means controls the medical device based on the specific operation when the specific operation detected by the operation detecting means is performed at a predetermined place. Medical equipment. The control means is used for medical treatment based on the specific motion when the specific motion detected by the motion detecting means is performed at a location exceeding a predetermined distance from the patient's body. The medical device according to claim 8, wherein the medical device is controlled and the specific operation is performed at a place not exceeding the predetermined distance, and the medical device is not controlled. The case where the specific operation detected by the operation detecting means is performed at the first location and the case where the specific operation is performed at a second location different from the first location. The medical device according to claim 1, wherein the control content by the control means is different. When the specific motion detected by the motion detecting means is performed at a location exceeding a predetermined distance from the patient's body, and when the specific motion is performed at a predetermined distance. The medical device according to claim 10, wherein the control content by the control means differs depending on whether the control is performed at a location that does not exceed the limit. The control means starts the operation of the medical device based on the specific motion detected by the motion detecting means, and when the medical device is in a predetermined state, the medical device is in a predetermined state. The medical device according to claim 1, wherein the operation of the medical apparatus is started. The medical device according to claim 12, wherein the control means starts the operation of the medical device when the medical device is inside the oral cavity of the patient. The medical device according to claim 12, wherein the control means starts the operation of the medical device when the medical device is outside the oral cavity of the patient. The medical device according to claim 1, wherein the control means controls the medical device based on specific movements of a plurality of points of the medical person detected by the motion detecting means. An motion detection means that detects a specific motion of the clinician based on the information acquired by the information acquisition means that acquires the information used for detecting the motion of the clinician who performs medical treatment about dentistry without touching the clinician. ,
A determination means for determining the content of control of the medical device used for the medical treatment based on the specific operation detected by the motion detection means, and a determination means.
Information processing system equipped with.

Images