WO2016080118A1

WO2016080118A1 - Endoscopic system

Info

Publication number: WO2016080118A1
Application number: PCT/JP2015/079181
Authority: WO
Inventors: 倉　康人; 本田　一樹; 健夫鈴木; 高範渡辺
Original assignee: オリンパス株式会社
Priority date: 2014-11-18
Filing date: 2015-10-15
Publication date: 2016-05-26
Also published as: JP6064091B2; US20170215693A1; JPWO2016080118A1

Abstract

This endoscopic system 1 comprises: an insertion unit 10 that is inserted inside a subject; a first image acquisition unit 13 that is provided in the insertion unit 10 and acquires a first image from a first region of the subject; second image acquisition units 16, 17 that are provided in the insertion unit 10 and acquire a second image from a second region of the subject the second region including a region adjacent to the first region; and an image processing unit that sets a first display region and adjacent second display regions in respective display units 5, 6, 7 for displaying images and carries out image processing so that the first image is disposed in the first display region, a portion of the second image is disposed in the first display region adjacent to the first image, and the remaining portion of the second image is disposed in the second display region.

Description

Endoscope system

The present invention relates to an endoscope system, and more particularly, to an endoscope system that acquires subject images of a front visual field and a side visual field.

Conventionally, endoscopes are widely used in the medical field and the industrial field. The endoscope includes an illuminating unit and an observing unit at the distal end side of the insertion portion, and can be inserted into the subject to observe and inspect the subject.

In recent years, for example, as disclosed in Japanese Patent Publication No. 2013-544617, in addition to a front visual field in which the front side of the insertion portion is an observation visual field, a side visual field in which the side surface side of the insertion portion is an observation visual field is provided. A multi-camera endoscope that can observe two or more directions provided has been proposed. If such a multi-camera endoscope is used, the examiner can observe the inside of the subject with a wide-angle visual field by simultaneously observing the two directions of the front and the side.

However, the conventional multi-camera endoscope has a problem that it is difficult to simultaneously view all of the front view screen and the side view screens provided on the left and right sides for the front view.

Therefore, users such as doctors have a problem that the lesion is overlooked or fatigue is increased by carefully watching all the screens.

Furthermore, in the conventional multi-camera endoscope, the observation image of the subject is often displayed in a round shape, and even when the observation can be performed on one screen, the screen is horizontally long, so the unused space on the screen. Will increase.

Therefore, the present invention has been made in view of the above circumstances, and can reduce the waste of the observation image displayed on the screen and display it efficiently, and improve the visibility of the observation image, thereby reducing fatigue to the user. An object of the present invention is to provide an endoscope system that reduces the weight of the endoscope system.

An endoscope system according to an aspect of the present invention includes an insertion unit that is inserted into a subject, and a first image acquisition unit that is provided in the insertion unit and acquires a first image from a first region of a subject. A second image acquisition unit that is provided in the insertion unit and acquires a second image from a second region of the subject including a region adjacent to the first region, and a display unit for displaying the image A first display area and a second display area adjacent to the first display area are respectively set, the first image is arranged in the first display area, and a part of the second image is set in the first display area. An image processing unit that is disposed adjacent to the first image in the display area and that performs image processing so that the remaining portion of the second image is disposed in the second display area.

According to the present invention, it is possible to provide an endoscope system that can efficiently display an observation image displayed on a screen by reducing waste, and can improve fatigue of the user by improving the visibility of the observation image.

The block diagram which shows the structure of the endoscope system in connection with a 1st form Schematic showing the configuration of a processor for displaying an observation image on the three display devices The figure explaining the image area cut out from the captured image area The figure for demonstrating the state by which the image area for front visual fields is converted similarly The figure for demonstrating the state in which the image area for 1st side views is converted similarly The figure for demonstrating the state by which the image area for 2nd side views is converted similarly The figure explaining the procedure of image processing The figure which shows the state which displayed the observation image on the same three display apparatuses The figure which shows the state which displayed the observation image on the same display device Schematic diagram showing the configuration of a processor for displaying an observation image on the display device of the first modified example The figure explaining the procedure of the image processing of the 1st modification similarly The figure which shows the state which displayed the observation image on three display apparatuses of a 1st modification similarly. The figure which shows the state which displayed the observation image on one display apparatus of a 1st modification similarly. Schematic showing the configuration of a processor for displaying an observation image on the display device of the second modification example The figure explaining the procedure of the image processing of the 2nd modification similarly The figure which shows the state which displayed the observation image on three display apparatuses of a 2nd modification as well. The figure which shows the state which displayed the observation image on one display apparatus of a 2nd modification similarly. Schematic diagram showing the configuration of a processor for displaying an observation image on the display device of the third modification example The figure explaining the procedure of the image processing of a 3rd modification same as the above The figure which shows the state which displayed the observation image on three display apparatuses of a 3rd modification similarly. The figure which shows the state which displayed the observation image on one display apparatus of a 3rd modification similarly. Schematic diagram showing the configuration of a processor for displaying an observation image on the display device of the fourth modification example The figure explaining the procedure of the image processing of a 4th modification as same as the above The figure which shows the state which displayed the observation image on three display apparatuses of a 4th modification as same as the above. The figure which shows the state which displayed the observation image on one display apparatus of a 4th modification similarly. Schematic showing the configuration of the processor for displaying the observation image on the display device of the fifth modification example The figure explaining the procedure of the image processing of a 5th modification as same as the above The figure which shows the state which displayed the observation image on three display apparatuses of a 5th modification as same as the above. The figure which shows the state which displayed the observation image on one display apparatus of a 5th modification similarly. The figure which shows five display apparatuses with which the subject image image | photographed with the endoscope in connection with 2nd Embodiment was displayed similarly. The perspective view which shows the structure of the front-end | tip part of the endoscope of a modification same as the above The figure which shows five display apparatuses with which the subject image image | photographed with the endoscope of the modification was displayed similarly. The figure which shows one display apparatus with which the subject image image | photographed with the endoscope of the modification was displayed similarly. The figure which shows the display apparatus on which the image recording part and endoscope image in connection with 3rd Embodiment were displayed The perspective view of the front-end | tip part 11 of the insertion part 10 to which the unit for side observation in connection with 4th Embodiment was attached.

Hereinafter, the endoscope apparatus according to the present invention will be described. In the following description, the drawings based on each embodiment are schematic, and the relationship between the thickness and width of each part, the thickness ratio of each part, and the like are different from the actual ones. It should be noted that the drawings may include portions having different dimensional relationships and ratios between the drawings.

Note that the endoscope in the following description of the configuration will be described by taking a so-called flexible endoscope having an insertion portion flexible for insertion into the digestive organs of the upper or lower part of the living body, but is not limited thereto. In addition, the technique can be applied to a so-called rigid endoscope having a hard insertion portion used for surgery.

(First embodiment)
First, an endoscope system according to an aspect of the present invention will be described with reference to the drawings.
FIG. 1 is a configuration diagram showing the configuration of an endoscope system according to the present embodiment, FIG. 2 is a schematic diagram showing the configuration of a processor that displays observation images on three display devices, and FIG. FIG. 4 is a diagram for explaining a state where an image region for a front visual field is converted, and FIG. 5 is a diagram for explaining a state where an image region for a first side visual field is converted. FIG. 6 is a diagram for explaining the state in which the image area for the second lateral field of view is converted, FIG. 7 is a diagram for explaining the procedure of image processing, and FIG. 8 is an observation on three display devices. FIG. 9 is a diagram illustrating a state in which an image is displayed. FIG. 9 is a diagram illustrating a state in which an observation image is displayed on one display device.

An endoscope system 1 shown in FIG. 1 includes an endoscope 2, a processor 3, a light source device 4, and

monitors

5, 6, and 7 as three display devices here.

The endoscope 2 has a flexible insertion portion 10 to be inserted into the subject and an operation unit (not shown), and is connected to the processor 3 and the light source device 4 by an endoscope cable (not shown). Has been.

The endoscope 2 includes a front-view illumination window (first illumination unit) 12, an observation window (first image acquisition unit) 13, and two side-view illuminations at the distal end portion 11 of the insertion unit 10. Windows (second illumination units) 14 and 15 and two observation windows (second image acquisition units) 16 and 17 are provided.

That is, the endoscope 2 has two

illumination windows

14 and 15 here in addition to the illumination window 12, and has two

observation windows

16 and 17 here in addition to the observation window 13. .

The illumination window 14 and the observation window 16 are for the first side field, and the illumination window 15 and the observation window 17 are for the second side field. The plurality of, here two,

observation windows

16 and 17 are arranged at a substantially uniform angle in the circumferential direction of the insertion portion 10.

The distal end portion 11 of the insertion portion 10 has a distal end rigid member (not shown), the illumination window 12 is provided on the distal end surface of the distal end rigid member, and the two

illumination windows

14 and 15 are disposed on the side surface of the distal end rigid member. Is provided.

In the front end portion 11, an imaging unit 21 for the front visual field is disposed behind the observation window 13 for the front visual field. In the distal end portion 11, a first side-view imaging unit 22 is disposed behind the observation window 16, and a second side-view imaging unit 22 is disposed behind the observation window 17. An imaging unit 23 is provided.

Each of the three

imaging units

21, 22, and 23 serving as an imaging unit has an imaging element such as a CCD or a CMOS, is electrically connected to the processor 3, and is controlled by the processor 3 to send an imaging signal to the processor 3. Output. Accordingly, each of the

imaging units

21, 22, and 23 constitutes an imaging unit that photoelectrically converts an image (subject image).

The observation window 13 is arranged at the distal end portion 11 of the insertion portion 10 in the direction in which the insertion portion 10 is inserted, and the

observation windows

16 and 17 are arranged at the side surface portion of the insertion portion 10 in the outer diameter direction of the insertion portion 10. Is arranged.

That is, the observation window 13 is provided at the distal end portion 11 of the insertion unit 10 and constitutes a first image acquisition unit that acquires a first subject image that is a first image from a front region that is a first region. is doing.

In addition, each of the

observation windows

16 and 17 is provided at the distal end portion 11 of the insertion portion 10 and is a second image which is a second image from the side which is a second region as a region in the left-right direction here, which is different from the front. A second image acquisition unit is configured to acquire two subject images.

In other words, the first subject image that is the first image becomes the subject image of the first region including the front of the insertion portion that is substantially parallel to the longitudinal direction of the insertion portion 10, and the second subject that is the second image. The image becomes the subject image of the second region in the left-right direction including the side of the insertion portion that is substantially orthogonal to the longitudinal direction of the insertion portion 10. The second region may be a vertical region provided at a position where the positions of the

observation windows

16 and 17 are rotated by approximately 90 degrees around the central axis of the insertion portion 10.

A light-emitting element 24 for front-view illumination is disposed behind the illumination window 12 for front-view. In addition, on the rear side of the illumination window 14, a first side-view illumination light emitting element 25 is disposed in the distal end portion 11. Then, on the rear side of the illumination window 15, an illumination light emitting element 26 for the second side field of view is disposed in the distal end portion 11.

These illumination light emitting elements (hereinafter referred to as illumination light emitting elements) 24, 25, and 26 are, for example, light emitting diodes (LEDs).
Accordingly, the illumination window 12 corresponding to the illumination light-emitting element 24 is an illumination unit that emits illumination light forward, and the

illumination windows

14 and 15 corresponding to the illumination light-emitting

elements

25 and 26 illuminate laterally. An illumination unit that emits light.

The processor 3 includes a photometry unit 31 and a control unit 32. The control unit 32 receives three imaging signals output from the three

imaging units

21, 22, and 23 via the

imaging cables

21a, 22a, and 23a, and three endoscopic images based on these three imaging signals. Are synthesized and output to the three

monitors

5, 6, and 7.

The light source device 4 has a built-in illumination control unit 33. The illumination control unit 33 is controlled by the control unit 32 of the processor 3.

The illumination control unit 33 is a circuit that controls the light emission amount and on / off of the illumination

light emitting elements

24, 25, and 26. The illumination control unit 33 is connected to the illumination

light emitting elements

24, 25, and 26 via the

signal lines

24a, 25a, and 26a. Output a control signal. Further, the illumination control unit 33 controls the amount of light of each illumination

light emitting element

24, 25, 26 based on the dimming signal from the control unit 32.

Furthermore, the illumination control unit 33 controls the on / off emission timing of each illumination light emitting element. That is, the illumination control unit 33 constitutes an illumination control unit that controls the emission of illumination light forward and the emission of illumination light to the side at predetermined timings different from each other.

The endoscope system 1 configured as described above synthesizes subject images acquired by the

respective imaging units

21, 22, 23 provided at the distal end portion 11 of the endoscope 2 to provide three

monitors

5, 6. , 7 are displayed.

At this time, the composite image generated by the control unit 32 of the processor 3 as an image generation unit is displayed on the three

monitors

5, 6, and 7.

Specifically, as shown in FIG. 2, the control unit 32 of the processor 3 includes a display area setting unit 35, three

cutout units

41, 42, 43, three

image conversion units

44, 45, 46, An image composition unit 47 and an image recording unit 48 such as various memories are provided. The image recording unit 48 may be configured to be detachable from the processor 3.

In the three

cutout portions

41, 42, and 43, the photometric signals obtained by photoelectric conversion by the three

image pickup units

21, 22, and 23 built in the distal end portion 11 of the endoscope 2 are measured by the photometry unit 31 and the display area setting unit 35. Respectively.

Specifically, the imaging signal from the imaging unit 21 for the front visual field is input to the cutout unit 41 for the front visual field, and the imaging signal from the imaging unit 22 for the first lateral visual field is the first side visual field. The image pickup signal from the second side view image pickup unit 23 is input to the second side view cutout portion 43.

That is, three

cutout portions

41, 42, and 43 are provided in the control unit 32 for each visual field direction of the endoscope 2.

As shown in FIG. 3, these three

cutout units

41, 42, and 43 are predetermined from the approximately circular captured image region 50 here based on the respective input captured image signals, each of which is a square here. Only the image information of the

image areas

51, 52, and 53 is converted into a captured (masked) image signal.

The three

cutout units

41, 42, and 43 are

image conversion units

44, 45, and 46 that are electrically connected to imaging signals obtained by cutting out only the image information of the set predetermined

image areas

51, 52, and 53. Output to.

These three

image conversion units

44, 45, and 46 convert an image based on the input imaging signal into a set shape.

Specifically, as shown in FIG. 4, the image conversion unit 44 for the front visual field makes the cut out predetermined image region 51 circular, and then masks the upper and lower sides so that both sides are convex. Distort to form an arc.

At this time, the image conversion unit 44 distorts the left and right corners UL, UR above and below the left and right corners DL of the image area 51 inwardly (center side), and also moves the image area 51 in the vertical direction. The left and right intermediate portions CL and CR are converted into image data having an image shape distorted outward (on the opposite side to the center side).

Further, as shown in FIG. 5, the first side-view image conversion unit 45 distorts the cut out predetermined image region 52 so that the left side is convex and the right side is concave.

At this time, the image conversion unit 45 distorts the left and right corners UL, UR above and below the left and right corners DL of the image region 52 to the right, and the left and right intermediate portions CL of the image region 51 in the vertical direction. , CR is converted into image data having an image shape distorted to the left.

Specifically, as shown in FIG. 4, the image conversion unit 44 for the front visual field transforms the cut out predetermined image area 51 into a round image, and performs adjustments such as masking up and down thereafter, for example. By doing so, both sides such as an oval, a circle, and a barrel are distorted so as to form a convex arc.

At this time, the image conversion unit 46 deforms the left and right corners UL, UR above and below the left and right corners DL of the image region 53 to the left, and the left and right intermediate portions CL of the image region 51 in the vertical direction. , CR is converted into image data having an image shape deformed to the right.

Each of the

image conversion units

44, 45, and 46 has a convex curve on the left and right sides of the converted image region 51 in the front visual field direction, and left and right of the two

image regions

52 and 53 in the converted lateral visual field direction. The

image regions

51, 52, and 53 are distorted so that the concave curved shape on one side matches.

The

image conversion units

44, 45, 46 output the converted image data of the

image areas

51, 52, 53 to the image composition unit 47.

Then, the image composition unit 47 matches the concave shapes of the

image regions

52 and 53 with the convex shapes of the left and right sides of the image region 51 in the input three image data of the

image regions

51, 52 and 53. Composite into one image.

At this time, the image composition unit 47 sets the image area 51 that is the front visual field in the center, and sets the first side visual field image area 52 to the left of the image area 51 so as to be adjacent to the image area 51. Then, the image area 52 for the second side field of view is synthesized as the right side with respect to the image area 51.

The combined image data is converted from the image combining unit 47 to a predesignated magnification, converted into a display signal by the image output unit 49, and output to the three

monitors

5, 6, and 7.

At this time, the image composition unit 47 outputs the composite image data obtained by combining the three image data of the

image areas

51, 52, and 53 to the image recording unit 48 at the same time. The image recording unit 48 records input composite image data.

Then, in the display area of the monitor 5 installed in the center, as shown in FIG. 2, an observation image of the image area 51 in the front visual field direction is displayed in the center, and two image areas 52 in each lateral visual field direction are displayed. , 53, a part of the

observation images

52a, 53a adjacent to the image region 51 is displayed.

That is, the monitor 5 has a first display area where the observation image of the image area 51 is displayed and a second display area where the

observation images

52a and 53a are displayed.

The display area setting unit 35 of the processor 3 recognizes each of the first display area and the second display area, and the observation image of the image area 51 is displayed in the first display area as described above. The observation images are allocated by setting the display so that the

observation images

52a and 53a are arranged.

At this time, the observation image of the image area 51 in the front visual field direction, the image area 51 displayed in the first display area among the two

image areas

52 and 53 in the lateral visual field direction, and the image area 51 The display ratio of some of the

observation images

52a and 53a displayed in the adjacent second display area can be arbitrarily set by the user.

Also, on the monitor 6 installed on the left side of the monitor 5, the remaining portion of the observation image 52b excluding the observation image 52a in the image region 52 in the first lateral visual field direction is displayed.

Note that, on the monitor 7 installed on the right side of the monitor 5, the remaining portion of the observation image 53 b excluding the observation image 53 a in the image region 53 in the second lateral visual field direction is displayed.

That is, in the endoscope system 1 of the present embodiment, as shown in FIG. 7, the control unit 32 of the processor 3 converts the round images of the three captured image areas 50 into three

image cutout units

41, 42, and 43. Cut into squares.

In the control unit 32, the image conversion unit 44 converts the front image region 51 into a round shape such as an oval, a circle, and a barrel shape, and converts the two

side image regions

52 and 53 into the

image conversion unit

45, 46 is converted into a concave shape, and the image composition unit 47 composes the three

image regions

51, 52, and 53.

Thus, as shown in FIG. 8, the endoscope system 1 displays the front image area 51 in the first display area of the monitor 5, and the

side image areas

52 and 53 in the second display area. Some

observation images

52a and 53a are displayed.

The remaining

observation images

52b and 53b in the

side image areas

52 and 53 are displayed on the

monitors

6 and 7, respectively.

Thus, the horizontal dimensions of the side images displayed in the display areas are displayed almost correctly on the three

monitors

5, 6, and 7.

Furthermore, the endoscope system 1 records the processed image in the image recording unit 48 provided in the control unit 32 of the processor 3.

As described above, in the endoscope system 1 according to the present embodiment, in addition to the observation image in the front visual field direction, a part of the observation image in each lateral visual field direction is displayed on the monitor 5 disposed in the center. Thus, the subject image is displayed without waste.

Therefore, the endoscope system 1 can efficiently display the observation image of the front visual field and the observation image of each lateral visual field, and can feel continuity in the information of the subject image. That is, an image having an impression that an observation image in the front visual field direction and an observation image in each lateral visual field direction from the center of the central monitor 5 spread left and right.

In addition, even if the user concentrates on the monitor 5 arranged at the center, the observation image of each side field of view is also displayed so that the information on the side of the subject image is also included. Oversight of lesions is prevented. The user is therefore required to look carefully at all the

monitors

5, 6, and 7 in order to obtain information on the subject image on the side, and the degree of fatigue is reduced.

As described above, the endoscope system 1 reduces the fatigue of the user by reducing the waste of the observation image displayed on the

monitors

5, 6, and 7 as the screen and improving the visibility of the observation image. can do.

The second region (side view) different from the first region (front view) means that the optical axis is in a different direction, and the view is greatly lost when the image is cut out. As shown in the figure, the range of the front field of view and the side field of view is slightly small without overlapping, even if a part of the boundary between the front field of view and the side field of view is overlapped or adjacent to each other with almost no gap. It may be separated by an interval.

Further, image processing for reducing a sense of discomfort may be performed by performing boundary processing for smoothly connecting the first subject image and the second subject image to adjacent portions.

Note that, as shown in FIG. 9, the display portions are set as areas to be displayed one by one on the screens of the three

monitors

5, 6, and 7, but a plurality of, for example, three display portions are displayed on one screen of one monitor. May be set by the processor 3 and may have a function of switching to operate in another operation mode in which a front view image and a side view image are displayed on the plurality of display portions, respectively.

(First modification)
FIG. 10 is a schematic diagram illustrating a configuration of a processor that displays an observation image on the display device according to the first modified example, FIG. 11 is a diagram illustrating an image processing procedure according to the first modified example, and FIG. FIG. 13 is a diagram illustrating a state in which an observation image is displayed on three display devices according to a modification. FIG. 13 is a diagram illustrating a state in which the observation image is displayed on one display device according to a first modification.

As shown in FIG. 10, the endoscope system 1 according to the present modification includes an image division / distribution unit 36 instead of the image synthesis unit 47 in the control unit 32 of the processor 3, and includes three

monitors

5, 6, and 7. In addition, a monitor 38 is provided.

In the endoscope system 1 configured as described above, as shown in FIG. 11, the round images of the three captured image areas 50 are squared by the three

image cutout units

41, 42, and 43 of the control unit 32 of the processor 3. cut.

The control unit 32 converts the front image region 51 into a round shape such as an oval, a circle, and a barrel shape by the image conversion unit 44, and converts the two

side image regions

52 and 53 into the

image conversion unit

45, 46 is converted into a concave shape.

Thereafter, the control unit 32 performs conversion so that the image division / distribution unit 36 can divide a part of the

side image regions

52 and 53 and display it together with the front image region 51 (note that only that portion may be synthesized). .

Thus, the endoscope system 1 displays the front image area 51 in the first display area of the monitor 5 out of the three

monitors

5, 6, and 7, as shown in FIG. The

partial observation images

52a and 53a of the

side image regions

52 and 53 are displayed in the region, and the remaining

side observation images

52b and 53b are displayed on the

monitors

6 and 7.

By adopting such a configuration, the endoscope system 1 can prevent part of the images on both sides from being hidden at the boundary between the monitor 5 and the

monitors

6 and 7.

As shown in FIG. 13, in the endoscope system 1 of the present modification as well, the display portions are set as areas to be displayed one by one on the screens of the three

monitors

5, 6, 7 respectively. There is a function of setting a plurality of, for example, three display portions on one screen of 38 by the processor 3 and switching to operate in another operation mode in which the front view image and the side view image are respectively displayed on the plurality of display portions. You may do it.

(Second modification)
FIG. 14 is a schematic diagram illustrating a configuration of a processor that displays an observation image on the display device according to the second modified example, FIG. 15 is a diagram illustrating an image processing procedure according to the second modified example, and FIG. FIG. 17 is a diagram illustrating a state in which an observation image is displayed on three display devices according to a modification. FIG. 17 is a diagram illustrating a state in which the observation image is displayed on one display device according to a second modification.

As shown in FIG. 14, the endoscope system 1 of the present modification is not provided with the

image conversion units

44, 45, 46 in the control unit 32 of the processor 3, and includes three

monitors

5, 6, 7 and the like. Further, a monitor 38 is provided.

In the endoscope system 1 of this modification configured as described above, as shown in FIG. 15, the round images of the three captured image areas 50 are converted into the three

image cutout units

41, 42, 42 of the control unit 32 of the processor 3. Cut out a square with 43.

Then, the control unit 32 combines the cut-out square front and side three

image regions

52 and 53 by the image combining unit 47, and, as shown in FIG. The front image area 51 is displayed in the first display area of the monitor 5 and the

observation images

52a and 53a of the

side image areas

52 and 53 are displayed in the second display area. , 7 display the remaining

lateral observation images

52b, 53b.

Furthermore, the endoscope system 1 also records the processed image in the image recording unit 48 provided in the control unit 32 of the processor 3 here.

With such a configuration, the endoscope system 1 can display the horizontal dimension of the side image displayed in each display area almost correctly.

As shown in FIG. 17, in the endoscope system 1 of the present modification, the display portions are set as areas to be displayed one by one on the screens of the three

monitors

5, 6 and 7, but one monitor There is a function of setting a plurality of, for example, three display portions on one screen of 38 by the processor 3 and switching to operate in another operation mode in which the front view image and the side view image are respectively displayed on the plurality of display portions. You may do it.

(Third Modification)
FIG. 18 is a schematic diagram illustrating a configuration of a processor that displays an observation image on a display device according to a third modification, FIG. 19 is a diagram illustrating an image processing procedure according to the third modification, and FIG. FIG. 21 is a diagram illustrating a state in which an observation image is displayed on three display devices according to a modification, and FIG. 21 is a diagram illustrating a state in which the observation image is displayed on one display device according to a third modification.

As shown in FIG. 18, the endoscope system 1 according to the present modification is not provided with the

image conversion units

44, 45, and 46 in the control unit 32 of the processor 3. A distribution unit 36 is provided, and a monitor 38 is further provided in addition to the three

monitors

5, 6, and 7.

In the endoscope system 1 of this modification configured as described above, as shown in FIG. 19, the three

image cutout units

41, 42, Cut out a square with 43.

Then, the control unit 32 performs conversion so that the image division / distribution unit 36 can divide a part of the

side image areas

52 and 53 and display it together with the front image area 51 (only the part may be synthesized). .

In this way, the endoscope system 1 displays the front image area 51 in the first display area of the monitor 5 among the three

monitors

5, 6, and 7 as shown in FIG. The

partial observation images

52a and 53a of the

side image regions

52 and 53 are displayed in the region, and the remaining

side observation images

52b and 53b are displayed on the

monitors

6 and 7.

monitors

6 and 7.

As shown in FIG. 21, in the endoscope system 1 of the present modification as well, the display portions are set as areas to be displayed one by one on the screens of the three

monitors

(Fourth modification)
FIG. 22 is a schematic diagram illustrating a configuration of a processor that displays an observation image on a display device according to a fourth modification, FIG. 23 is a diagram illustrating an image processing procedure according to the fourth modification, and FIG. FIG. 25 is a diagram illustrating a state in which an observation image is displayed on three display devices according to a modification, and FIG. 25 is a diagram illustrating a state in which the observation image is displayed on one display device according to a fourth modification.

As shown in FIG. 22, the endoscope system 1 according to the present modification includes only two

image conversion units

45 and 46 in the control unit 32 of the processor 3, and includes three

monitors

5, 6, and 7. Further, a monitor 38 is provided.

In the endoscope system 1 of the present modified example configured as described above, as illustrated in FIG. 23, the control unit 32 of the processor 3 causes the image cutout unit 41 to generate a front image from the round images of the three captured image areas 50. Are cut into a round shape such as an oval, a circle, or a barrel, and the

image cutout units

42 and 43 cut out the two side images into a square.

Then, the control unit 32 converts the two

side image regions

52 and 53 into a concave shape without converting the front image region 51, and the image composition unit 47 generates three images. The

areas

51, 52 and 53 are synthesized.

Thus, as shown in FIG. 24, the endoscope system 1 displays the front image area 51 in the first display area of the monitor 5 and the

side image areas

52 and 53 in the second display area. Some

observation images

52a and 53a are displayed.

The remaining

observation images

52b and 53b in the

side image areas

52 and 53 are displayed on the

monitors

6 and 7, respectively.

With such a configuration, the endoscope system 1 displays the horizontal dimensions of the side images displayed in the display areas of the three

monitors

5, 6, and 7 almost correctly.

As shown in FIG. 25, in the endoscope system 1 of the present modification, the display portions are set as areas to be displayed one by one on the screens of the three

monitors

(Fifth modification)
FIG. 26 is a schematic diagram showing the configuration of a processor that displays an observation image on the display device of the fifth modification, FIG. 27 is a diagram for explaining the procedure of image processing of the fifth modification, and FIG. FIG. 29 is a diagram illustrating a state where an observation image is displayed on three display devices according to a modification. FIG. 29 is a diagram illustrating a state where an observation image is displayed on one display device according to a fifth modification.

As shown in FIG. 26, the endoscope system 1 according to the present modification is provided with only two

image conversion units

45 and 46 in the control unit 32 of the processor 3, and further changes to the image composition unit 47 to divide the image. A distribution unit 36 is provided, and a monitor 38 is further provided in addition to the three

monitors

5, 6, and 7.

In the endoscope system 1 of the present modified example configured as described above, as illustrated in FIG. 27, the control unit 32 of the processor 3 causes the image cutout unit 41 from the round images of the three captured image regions 50 to be a front image. Are cut into a round shape such as an oval, a circle, or a barrel, and the

image cutout units

42 and 43 cut out the two side images into a square.

In the control unit 32, only the two

side image regions

52 and 53 are converted into concave shapes by the

image conversion units

45 and 46.

side image regions

In this way, the endoscope system 1 displays the front image area 51 in the first display area of the monitor 5 out of the three

monitors

5, 6, and 7, as shown in FIG. The

partial observation images

52a and 53a of the

side image regions

52 and 53 are displayed in the region, and the remaining

side observation images

52b and 53b are displayed on the

monitors

6 and 7.

monitors

6 and 7.

As shown in FIG. 29, in the endoscope system 1 according to the present modification, the display portions are set as areas to be displayed one by one on the screens of the three

monitors

5, 6, and 7. There is a function of setting a plurality of, for example, three display portions on one screen of 38 by the processor 3 and switching to operate in another operation mode in which the front view image and the side view image are respectively displayed on the plurality of display portions. You may do it.

(Second Embodiment)
Next, an endoscope system according to a second embodiment of the present invention will be described below based on the drawings. In the following description, the same constituent elements described in the first embodiment described above are denoted by the same reference numerals, and detailed description thereof will be omitted.

30 is a diagram showing five monitors on which subject images photographed by an endoscope are displayed, FIG. 31 is a perspective view showing a configuration of a distal end portion of a modified endoscope, and FIG. 32 is a modified example. FIG. 33 is a diagram showing five monitors on which subject images photographed by an endoscope are displayed, and FIG. 33 is a diagram showing one monitor on which subject images photographed by an endoscope of a modified example are displayed.

As shown in FIG. 30, the endoscope system 1 according to the present embodiment includes

monitors

5, 6, 7, and 8 that are five display devices that display an endoscopic image synthesized by a processor 3 (not shown). , 9.

That is, the endoscope system 1 newly has two monitors 8 and 9 in the vertical direction with respect to the monitor 5 disposed in the center in addition to the configuration of the first embodiment.

These two monitors 8 and 9 display the upper and lower portions of the subject image acquired by each

imaging unit

21, 22 and 23.

Specifically, as in the first embodiment, the central monitor 5 has an observation image 51a in the image area 51 of the front visual field and

observation images

52a and 53a in the captured

image areas

52 and 53 in the lateral visual fields. Is displayed.

Further, the left and

right monitors

6 and 7 are similar to the first embodiment, in the

image regions

52 and 53 in the lateral visual field directions, the remaining observation images 52b excluding the

observation images

52a and 53a. , 53b are displayed.

The upper and lower monitors 8 and 9 include the remaining

observation images

51b and 51c in the vertical direction excluding the observation image 51a and the captured

image regions

52 and 53 in the lateral views of the image area 51 of the front view. A part of the

observation images

52c, 52d, 53c, 53d in the vertical direction excluding the

observation images

52a, 52b, 53a, 53b is displayed.

Here, since the vertical direction in the

image areas

51, 52, 53 can be displayed on the upper and lower monitors 8, 9, the captured image area 50 (see FIG. 3) is not required to be cut out in the vertical direction. Note that the control for deforming and synthesizing the observation image is the same as in the first embodiment.

In the endoscope system 1 configured as described above, the monitor 5 in the captured image area 50 as the subject image acquired by each of the

imaging units

21, 22, and 23 is compared with the first embodiment. The cut-out (masking) portions that are not used in the

display areas

6 and 7 can be made as small as possible, and wide-angle observation images by the plurality of

imaging units

21, 22, and 23 can be shown effectively.

Further, the endoscope system 1 is provided with monitors 8 and 9 in addition to the center and left and

right monitors

5, 6, 7, so that subjects displayed on these five

monitors

5, 6, 7, 8, 9 are displayed. The appearance of the image becomes a three-dimensional impression, and the visibility can be improved.

Note that if the two monitors 8 and 9 arranged above and below are always displayed, the amount of information entering the user's field of view increases and the burden on the user increases. Display / non-display can be switched by a hand operation using a switch provided in an operation section of the device, a foot operation using a foot switch, a manual operation using a medical assistant, or the like.

Furthermore, the two monitors 8 and 9 may be configured to be housed on the back side of the central monitor 5 or the left and

right monitors

6 and 7 when they are not required.

Thereby, the endoscope system 1 can change a desired display form by the user, and can improve the efficiency and accuracy of the endoscopic examination.

(Modification)
In the above description, the three

observation windows

13, 16, 17 and the three

imaging units

21, 22, 23 are provided in the distal end portion 11 of the endoscope 2. However, as shown in FIG. 11, two

observation windows

27 and 28 and two

imaging units

29 and 30 may be provided.

In the distal end portion 11 of the insertion portion 10, a third side-view imaging unit 29 is disposed behind the observation window 27, and the fourth side is disposed behind the observation window 28. An imaging unit 30 for a field of view is provided.

Each of these

observation windows

29 and 30 is provided at the distal end portion 11 of the insertion portion 10, and the third subject image is viewed from a direction different from the front, which is the first direction, and the side, which is the second direction in the left-right direction. The third image acquisition unit that acquires the image is configured.

In other words, as described above, the first subject image is a subject image in the first direction including the front of the insertion portion substantially parallel to the longitudinal direction of the insertion portion 10, and the second subject image is the longitudinal length of the insertion portion 10. The subject image is in the second direction in the left-right direction including the side of the insertion portion that is substantially orthogonal to the direction, and the third subject image is substantially orthogonal to the longitudinal direction of the insertion portion 10 and also substantially orthogonal to the second direction. The subject image is in the third direction in the vertical direction.

The subject images in the front and up / down / left / right directions acquired by the five

imaging units

21, 22, 23, 29, and 30 are displayed on the five

monitors

5, 6, 7, 8, and 9, as shown in FIG. Is done.

Specifically, as described above, the central monitor 5 includes the observation image 51a of the image area 51 of the front visual field and the

observation images

52a and 53a of the captured

image areas

52 and 53 of the first and second lateral visual fields. Is displayed.

The left and

right monitors

6 and 7 display the remaining portions of the

observation images

52b and 53b except for the

observation images

52a and 53a among the

image regions

52 and 53 in the first and second lateral viewing directions. .

In the upper and lower monitors 8 and 9, the remaining

observation images

51b and 51c in the vertical direction, excluding the observation image 51a, and the images in the third and fourth lateral visual field directions in the image region 51 of the front visual field.

Areas

54 and 55 are displayed.

The endoscope system 1 configured as described above can display an observation image having a wider angle in the vertical direction in addition to the effects described above.

As shown in FIGS. 30 and 32, the display portions are set as areas to be displayed one by one on the screens of the five

monitors

5, 6, 7, 8, and 9, but as shown in FIG. A plurality of, for example, five display portions are set on one screen of one monitor (38) by the processor 3, and the front view image, the side view image and the vertical view image are respectively displayed on the plurality of display portions. A function of switching to operate in the operation mode may be provided.

In this case, the field-of-view image may be cut out in a round shape as shown in FIGS. 30 and 32, but as shown in the second and third modifications of the first embodiment, for example, in a square state May be displayed.

(Third embodiment)
Next, an endoscope system according to a third embodiment of the present invention will be described below based on the drawings. In the following description, the same constituent elements described in the first and second embodiments described above will be denoted by the same reference numerals, and detailed description thereof will be omitted. Furthermore, the configuration described below can be combined with the first and second embodiments.

FIG. 34 is a diagram illustrating a display device on which an image recording unit and an endoscopic image are displayed.
In the endoscope system 1 here, as shown in FIG. 34, when filing the image recording unit 48 provided in the control unit 32 of the processor 3, the front image region 51 and the

side image regions

52 and 53 are arranged. Is saved as a single image in a filing format, or in a plurality of recording modes in a filing format that is individually divided with the shooting times of the front image area 51 and the

side image areas

52 and 53 synchronized. It is configured so that the user can select whether to do.

Note that this selection can be switched by, for example, a switch provided in the operation unit of the endoscope 2 or a switch provided in the processor 3 (both not shown).

With such a configuration, the endoscope system 1 can record an observation image in a filing format corresponding to the user by setting the recording mode according to the user's preference. Searching and displaying the observation image in 53 can be performed efficiently. As a result, the user can easily review the observation image and create a report.

(Fourth embodiment)
In each embodiment and each modification described above, the mechanism that realizes the function of illuminating and observing the side is incorporated in the insertion unit 10 together with the mechanism that realizes the function of illuminating and observing the front. It is good also as a separate body which can be attached or detached with respect to the part 10. FIG.

FIG. 35 is a perspective view of the distal end portion 11 of the insertion portion 10 to which a side observation unit is attached according to the fourth embodiment.

The distal end portion 11 of the insertion portion 10 includes a front side viewing unit 600. The side view unit 500 has a structure that can be attached to and detached from the front view unit 600 by a clip portion 503.

The side view unit 500 has two observation windows 501 for acquiring images in the left-right direction and two illumination windows 502 for illuminating the left-right direction.

The processor 3 or the like obtains an observation image as described in the above-described embodiment by turning on and off each illumination window 502 of the side visual field unit 500 according to the frame rate of the front visual field. Display can be made.

As described above, according to each of the above-described embodiments and modifications, it is possible to provide an endoscope system that can be observed quickly when the viewing direction of an endoscope having a wide-angle field of view is changed.

The invention described in the above-described embodiment is not limited to the embodiment and modification examples, and various modifications can be made without departing from the scope of the invention in the implementation stage. Further, the above embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements.

For example, even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment, the described requirements can be deleted if the stated problem can be solved and the stated effect can be obtained. The configuration can be extracted as an invention.

This application is filed on the basis of the priority claim of Japanese Patent Application No. 2014-233871 filed in Japan on November 18, 2014, and the above content includes the present specification, claims, and It is cited in the drawing.

Claims

An insertion part to be inserted into the subject;
A first image acquisition unit provided in the insertion unit for acquiring a first image from a first region of the subject;
A second image acquisition unit that is provided in the insertion unit and acquires a second image from a second region of the subject including a region adjacent to the first region;
A first display area and a second display area adjacent to the first display area are set in a display unit for displaying an image, and the first image is arranged in the first display area. Is arranged adjacent to the first image in the first display area, and image processing is performed so that the remaining part of the second image is arranged in the second display area. An image processing unit;
An endoscope system comprising:
2. The image output unit according to claim 1, further comprising: an image output unit that converts the first image and the second image into display signals and outputs the display signal to the display unit. Endoscope system.
The image output unit includes:
Multiple display modes for displaying the first image and the second image on the plurality of display sections by assigning a plurality of adjacent different display sections as the first display area and the second display area, respectively. When,
A single display mode for displaying the first image and the second image by setting the first display region and the second display region next to each other on the same screen in one display unit; ,
The endoscope system according to claim 2, wherein the display signal is output by switching any one of them.
The endoscope according to claim 3, further comprising at least one display device that receives the display signal from the image output unit and displays the first image and the second image. system.
The endoscope according to claim 1, wherein the image processing unit arranges the remaining part of the second image in the second display area so as to be adjacent to the first display area. system.
The endoscope system according to claim 1, wherein the image processing unit synthesizes a part of each of the two second images so as to be adjacent to both sides of the first image.
The first image acquisition unit includes a first imaging unit that photoelectrically converts the first image;
The endoscope according to claim 1, wherein the second image acquisition unit includes a second imaging unit different from the first imaging unit that photoelectrically converts the second image. system.
The first area is an area including the front of the insertion section along the longitudinal direction of the insertion section, and the first image is an image of the first area acquired by the first image acquisition section. Yes,
The second region is a region including the side of the insertion unit orthogonal to the longitudinal direction of the insertion unit, and the second image is an image of the second region acquired by the second image acquisition unit. The endoscope system according to claim 1, wherein:
The endoscope system according to claim 1, further comprising an image conversion unit that converts at least one of the first subject image and the second subject image into a predetermined shape.
The image conversion unit converts a side end portion of the first subject image into a convex shape, and converts one side end portion of the second subject image to the shape of the first subject image. The endoscope system according to claim 9, wherein the endoscope system is converted into a concavely distorted shape that matches the convex shape.
The endoscope system according to claim 1, further comprising an image composition unit that composes the first subject image and the second subject image into one image.
The endoscope system according to claim 1, further comprising an image recording unit that records the first subject image and the second subject image.
A first mode in which the first image and the second image are combined into a single filing format and stored in the image recording unit;
A second mode in which the first image and the second image are stored in the image recording unit in a plurality of filing formats individually divided;
The first image and the second image synthesized in one filing format, and the first image and the second image divided as a plurality of filing formats are simultaneously stored in the image recording unit. 3 modes,
The endoscope system according to claim 12, further comprising a switch for selectively switching between.