JP4685561B2 - Display method of camera system and camera system - Google Patents

Description

  The present invention relates to a camera system that picks up a subject and freely selects and displays an area to be viewed from the picked-up image, and particularly in a surveillance camera system that picks up and monitors a subject having a depth, and wants to monitor the camera system. The present invention relates to a camera system in which an area is manually selected or automatically selected and displayed on a monitor.

Conventionally, when monitoring a subject with depth, such as a railway home surveillance camera system, multiple cameras are installed, and multiple images captured by each camera are transmitted to the monitor display section using video cables, and displayed on the monitor. Monitoring was performed by watching the images displayed on the screen. Therefore, it is necessary to move the camera every time the vehicle organization changes and the position of the subject changes.
In a movable camera that has a lens and a pan head, and controls the panoramic mechanism, tilt mechanism, zoom magnification changing mechanism, etc. to change the visual field range of the camera, change the visual field range to the area you want to monitor Although it is possible to cover a plurality of areas with a single camera by moving it, it has been impossible to grasp the entire situation at a time and immediately display an image in the desired area (for example, see Patent Document 1). .)

  A conventional camera system for monitoring a monitoring area having a depth will be further described with reference to FIG. FIG. 23 is a diagram illustrating a schematic configuration of a system for monitoring a monitoring area with a depth, such as monitoring of the status of a railway platform and monitoring of the status of getting on and off a train, and a display example of a monitor screen. FIG. 23 (a) shows the schematic configuration of the system as seen from above, 51-1 and 51-2 are TV cameras, and 52-1 to 52-4 are train vehicles. TV cameras, homes, and vehicles only show some, not all. Also, illustrations of other objects that should be on the platform and the train, such as passengers, are omitted to avoid complexity. Here, the monitor and the recording device are not shown in FIG. 22, but are installed in, for example, a driver's seat, a conductor's seat, a station office, or a monitoring center, and either TV cameras 51-1 and 51-2 are either wireless or wired. Alternatively, they are combined by well-known transmission means (not shown, for example, wireless LAN (Local Area Network), optical communication, etc.).

  FIG. 23 (b) is a diagram showing an example of display on the monitor screen of the images acquired by the TV cameras 51-1 and 51-2 shown in FIG. 23 (a), and 510 and 520 are display examples of the monitor screen. , 510-1 are images displayed in the display example 510 of the monitor screen, and 520-1 and 520-2 are images displayed in the display example 520. The number of TV cameras and monitors varies depending on the needs of the home length, shape, obstacles, number of passengers, budget, etc.

Railroad platforms are narrow, and there are obstacles in the platform, such as passengers, pillars, information boards, clocks, advertisements, and signal lights. There are many restrictions for installation, and the home does not always extend straight, and may be on a slope or have a step. For this reason, the viewing direction of the TV camera must be installed so that it is viewed from below the ceiling, and it must be installed in a direction almost parallel to the traveling direction of the train vehicle, and the number of TV cameras installed. Is also limited.
Accordingly, the TV cameras 51-1 and 51-2 shown in FIG. 23 (a) are combined with the transmission means, and the monitor displaying the images acquired by the TV cameras 51-1 and 51-2 is shown in FIG. ) Display examples 510 and 520, the vehicles in front of TV cameras 51-1 and 51-2 appear larger, and the vehicles in the back appear smaller.

  As shown in the upper part of Fig. 23 (b), in the case of a single screen displaying an image 510-1 obtained by combining images captured by the TV cameras 51-1 and 51-2 (in the case of a single TV camera, it is combined) In the display example 510 of “No”, it is possible to monitor not only near the entrance / exit but also the inside of the platform, but the depth of the screen (mainly, the train entrance / exit and the car side lights) is small and the depth of the screen is difficult to see. In addition, when images 520-1 and 520-2 captured by TV cameras 51-1 and 51-2 are displayed separately as shown in the display example 520 (division image) shown in the lower part of FIG. 23 (b). Or after combining, for example, when displaying divided for each vehicle, a TV camera is also provided at the back of the screen, but it can be seen to the back of the vehicle, but the inside of the home is cut and the entire screen is It is difficult to see.

  In addition, when an image taken with a normal TV camera is enlarged with electronic zoom on a part that needs to be monitored in particular (for example, in the vicinity of a crowded entrance / exit), the image quality deteriorates and monitoring is particularly necessary. Although this portion is enlarged, the visibility is not improved because the resolution is poor. For this reason, even if a high-resolution TV camera (for example, a megapixel camera) with high resolution (for example, a megapixel camera) is used to capture and display an enlarged image, the image quality is not deteriorated. Since the image quality of the image to be reproduced and the image to be reproduced is fixed, the image quality deteriorates when the image recorded from the recording device is reproduced and the partial area (image area) desired to be viewed is enlarged by image processing.

Japanese Patent Application Laid-Open No. 11-124036

Examples of deep locations include harbors, rivers, power plants, highways, traffic monitoring, station platforms, station premises, airports, and the like. When monitoring a plurality of these wide and wide areas with a large number of cameras, the number of cameras increases and the selection operation becomes complicated.
For example, when the monitoring area needs to be changed or the layout of the subject is changed (the layout of the monitoring place is changed), the camera needs to be moved each time. The more cameras that are installed, the more time and effort it takes to make changes.
In the surveillance camera system, a plurality of supervisors share the same image, but it is not possible to select an image of a point to be monitored for each supervisor and display it on each monitor.

An object of the present invention is to capture an area captured by a plurality of cameras with a TV camera having a large number of effective pixels, such as one megapixel camera, and freely divide the area of the image for each frame for each monitoring point. And providing a surveillance camera system capable of monitor display.
Also, by dividing the area, it is possible to reduce the large amount of data in the image frame of TV cameras with a large number of effective pixels, such as megapixel cameras, and efficiently distribute them to LANs.
Another object of the present invention is to capture a wide area monitoring system, which has been conventionally performed by a large number of cameras, with a TV camera having a large number of effective pixels, such as one or a small number of megapixel cameras, and monitor an area to be monitored while grasping the whole. The purpose is to monitor efficiently. Also, the alarm information and the image area are converted into a data map so that the area information is immediately displayed with images and characters.

In order to achieve the above object, the display method of the camera system of the present invention images one area by one or a plurality of cameras, and selects a predetermined divided area from the imaged one area. In the display method of the camera system for displaying on the monitor for each divided area selected in this manner, the size of the image of one area captured by one or a plurality of cameras is larger than the screen display resolution of the monitor. To do.
Preferably, the depth of the video in the predetermined divided area is corrected and displayed on the monitor.
Preferably, the camera is a 360 degree camera.
Preferably, the sensor and the divided area are associated in advance, and when the sensor generates an alarm, the video of the divided area associated with the sensor that has generated the alarm is displayed on the monitor.

  The camera system of the present invention also monitors one or more cameras that capture one area and a predetermined divided area selected from the captured video of one area for each selected divided area. And a control device that outputs to display the image in one area captured by one or a plurality of cameras, wherein the size of the image in one area is larger than the screen display resolution of the monitor.

In order to achieve the above object, the camera system of the present invention divides and transmits a video image captured by a TV camera having a large number of effective pixels into a plurality of areas to be monitored.
Further, the camera system of the present invention divides a video captured by a TV camera having a large number of effective pixels into a plurality of areas, and performs depth correction on each of the divided videos (displays an image in the depth direction of the screen in accordance with the depth). It is.
In addition, the camera system of the present invention can divide the image into areas when transmitting the image captured by the TV camera via the IP network, and transmit only the image in the required area, for example, in the VGA size. Compared to the image data transmission method, the transmission band is reduced.

  In addition, the camera system of the present invention preferably has a pixel size smaller than that of a TV camera, such as a VGA size, for example, by a GUI (Graphical User Interface) operation on an image captured by a TV camera having a large number of effective pixels. It is converted into video (for example, it is converted into an image of VGA size around the point clicked with a pointing device such as a mouse).

  The camera system of the present invention preferably detects an intruding object using an image processing device for an image captured by a TV camera having a large number of effective pixels, and an area centered on the detected intruding object is, for example, This is an automatic extraction with a pixel size smaller than the imaging pixel size of the TV camera such as VGA size.

  In the camera system of the present invention, preferably, the viewer selects an area that the viewer wants to watch by Internet distribution for sports broadcasts such as baseball and soccer, and the WEB server distributes the area in an enlarged manner. is there.

In the camera system of the present invention, preferably, the panoramic screen imaged by the 360 degree camera is divided into areas for each monitoring place in advance, and the area to be viewed in the screen is manually selected by GUI operation or automatically from the alarm information. Select and transmit.
The camera system of the present invention further maps the alarm occurrence area to a data map, and displays alarm information and alarm prediction.

According to the present invention, in a camera system that captures and monitors a deep subject with a camera, the entire subject is imaged with a TV camera having a large number of effective pixels, and the captured image is divided into a plurality of areas to be monitored. The resolution and the image size of the monitor image can be freely changed, and there is no need to change the camera position every time the angle of view is changed as in the prior art.
Also, when video captured by a TV camera with a large number of effective pixels is converted into data and transmitted via an IP network, the entire captured video is not converted into data, and only the divided areas necessary for monitoring are converted into data. Therefore, the amount of data can be reduced.
Further, by combining the present invention with an image processing apparatus, it is possible to automatically select an area around a subject such as an intruding object detected.

The system of the present invention can be applied to video that is distributed or broadcast in high definition, such as Internet distribution for sports broadcasts such as baseball and soccer, and the entire stadium is a TV camera with a large number of effective pixels such as a megapixel camera. It is possible to select an area that the viewer wants to see from the captured image.
In addition, by applying the present invention to a traffic flow monitoring system that monitors intersections in urban areas, etc., an image of the entire intersection 360 degrees captured with a megapixel camera is divided into areas for each monitoring point, and area images and location information, alarms By converting the information into a data map, the supervisor can grasp the situation of the entire intersection and simultaneously monitor the detailed image of the intersection and the image of the alarm occurrence point.

  An embodiment of the present invention will be described with reference to FIG. FIG. 1 is an image diagram of a camera arrangement and a captured image of a camera system that monitors a deep subject with a plurality of TV cameras. FIG. 1 shows only a part of the TV camera, home, and vehicle, not all of them. Also, illustrations of other objects that should be on the platform and the train, such as passengers, are omitted as much as possible to avoid complications.

The subject in FIG. 1 (a) is a schematic view of the train 4 stopped at the station platform as viewed from the head vehicle. The train 4 has, for example, a six-car train.
1-1 to 1-3 are TV cameras, for example, the TV camera 1-1 monitors the first and second vehicles, the TV camera 1-2 monitors the third to fourth vehicles, and the TV camera 1-3 The fifth and sixth vehicles are monitored.
TV cameras 1-1 to 1-3 are suspended from a roof of a home (not shown) by pillars 1-11, 1-12, and 1-13, respectively.

Fig. 1 (b) shows the schematic configuration of a part of the system when the platform and the train 4 are viewed from above. 4-1 is the leading vehicle of the train 4, 4-2 is the second vehicle of the train 4, and 4-3 Indicates the third vehicle in train 4 (the following vehicles are omitted).
The solid line extending from TV cameras 1-1 and 1-2 indicates the viewing range of the TV camera.

Fig. 1 (c) shows an image taken by TV camera 1-1, Fig. 1 (d) shows an image taken by TV camera 1-2, and Fig. 1 (e) shows an image taken by TV camera 1-3. Is displayed.
Here, although the monitor and the recording device are not shown in FIG. 1, for example, they are installed in a driver's seat, a conductor's seat, a station office, or a monitoring center, and each TV camera and either wireless or wired or a combination thereof are well known. Transmission means (not shown, for example, wireless LAN (Local Area Network), optical communication, etc.).

Figure 2 shows a viewing area that covers the entire train in a 6-car train, with one camera with a larger number of effective pixels than the resolution of a display device such as a monitor installed at the position of TV camera 1-1 (Figure 1). It is a screen when imaged as. The TV camera is, for example, a megapixel camera equipped with a CCD with 9 million effective pixels.
At this time, for example, the number of pixels taken by the TV camera is set to 3200 × 2400 dots (QUXGA size). The screen display resolution of the monitor is, for example, 640 × 480 dots (VGA size).
In addition, for example, a TV camera is a camera having a number of shooting pixels of 2048 × 1536 dots (QXGA size) or more.

Fig. 2 (a) is a train screen imaged by one TV camera. The area surrounded by the broken line 20-1 indicates that the TV camera 1-1 in FIG. 1 is equivalent to the field of view when the image is taken, and the area surrounded by the broken line 20-2 is shown in FIG. The area enclosed by the broken line 20-3 is the same as the field of view when the TV camera 1-3 in Fig. 1 captures. This indicates that this is an area. In FIG. 2, there is no FIG. 2 (b).
The image of the area surrounded by the broken line 20-1 is extracted as shown in FIG. 2 (c), and the image of the area surrounded by the broken line 20-2 is extracted as shown in FIG. 2 (d). The image of the area surrounded by -3 is extracted as shown in Fig. 2 (e).

The monitoring area corresponding to the TV cameras 1-1 to 1-3 in FIG. 1 is extracted by image processing, and an image obtained by partially expanding and correcting the depth is also shown.
That is, the image of FIG. 2 (c) is corrected as shown in FIG. 2 (c '), the image of FIG. 2 (d) is corrected as shown in FIG. 2 (d'), and the image of FIG. The image is corrected as shown in FIG.
Such a correction technique will be described later.

  FIG. 3 is a block diagram showing the configuration of an embodiment of the system of the present invention. 31 is a TV camera, 32 is a video controller for dividing the video of the TV camera 31 into multiple areas to be monitored, 33 is an operation PC (Personal Computer) for selecting each area to be divided, 34 is A monitor 35 for displaying the divided areas is a monitor for displaying the video of the TV camera 31. The TV camera 31 is a TV camera having a large number of effective pixels, such as a megapixel camera.

In FIG. 3, the TV camera 31 captures the visual field range and outputs the captured video to the video controller 32 as a video signal. The video controller 32 outputs the input video signal to the operation PC 33.
The operation PC 33 converts the video signal given from the video controller 32 to the display unit provided by itself or connected separately to the display format of the display unit and outputs it. The display unit displays the entire field of view imaged by the TV camera 31.

The operator operates the operation PC 33 using, for example, a pointing device such as a mouse or an input device such as a keyboard provided in the operation PC 33, and selects an area to be monitored.
In the case of a railway home monitoring camera system as shown in FIG. 1, the area to be monitored is, for example, near the top and bottom exits of a train, and one or a plurality of areas can be selected.
Then, the monitor to be displayed is selected or designated from among the monitors 34 and is output to the video controller 32 together with the information.
At this time, if the operator wants to display the information of the area to be displayed along with the image of the area to be displayed in characters or graphics (and further output sound), the setting can also be made. The area information includes, for example, the place name and lot number of the area (in the case of getting on and off the train, the order of the vehicle number, the entrance / exit number, etc.), time information, and the like.

The video controller 32 divides the video in the specified area from the video of the entire field of view captured by the TV camera 31 according to the instruction given from the operation PC 33, and applies the corresponding information together with the information instructed from the operation PC 33. Outputs video data and specified area information to monitor 34.
The monitor 34 outputs the given data as video or audio.

  In addition, the video controller 32 outputs the video of the entire visual field range captured by the TV camera 31 to the monitor 35, and the monitor 35 displays the video of the entire visual field range.

Next, detailed functions of the video controller 32 in FIG. 3 will be described with reference to FIG.
FIG. 4 is a block diagram for explaining the function of the video controller according to the embodiment of the present invention. 41 is a video distributor, 42 is an A / D conversion unit, 43 is an image memory unit, 44 is an area extraction unit, 45 is an image correction unit, 46 is a D / A conversion unit, 47 is a control unit, and 48 is an image quality conversion unit. It is.

The video acquired by the TV camera 31 is input to the video distribution unit 41 of the video controller 32 for each frame. The video distribution unit 41 distributes the input video for each frame and outputs it to the A / D conversion unit 42 and external devices (for example, the operation PC 33 and the monitor 35 in FIG. 3).
The A / D converter 42 converts the video signal into digital data and outputs it to the image memory 43 for each frame. The image memory unit 43 records the input video data.

When the information of the area selected by the operation PC 33 in FIG. 3 is input to the control unit 47, the control unit 47 detects the area selected by the operation personal computer and outputs the detected area information to the area extraction unit 44. In addition, the image memory unit 43 is instructed to output video data for one frame to the area extracting unit 44.
The image memory unit 43 outputs video data for one frame to the area extraction unit 44.

The area extraction unit 44 divides the video data input from the image memory unit 43 into each area for each frame based on the given area information, and outputs the divided data to the image correction unit 45.
At this time, the image quality conversion unit 48 matches the video size of each area with the same pixel size (size of screen display resolution). Each of the divided areas is input to the image correction unit 45, depth correction is performed by partial enlargement, and each area is output to the corresponding D / A conversion unit 46.
Finally, the D / A converter 46 converts the image for each area back to an analog video signal and outputs it to each monitor 34.

  Through the above process, the camera system that has been conventionally performed by a plurality of (three in this case) surveillance cameras can be realized by a camera having a large effective pixel size such as one megapixel camera.

  FIG. 5 is a block diagram showing a configuration of an embodiment of a system for transmitting the present invention to a client PC via an IP (Internet Protocol) network. FIG. 5 (a) shows a conventional transmission method for an IP network, and FIG. 5 (b) shows an embodiment of the transmission method for an IP network according to the present invention. 51 is a TV camera, 52 and 52 ′ are image distribution devices for distributing video captured by the TV camera 51 frame by frame, 53 is an IP network, 54 is a client PC for monitoring video, and 55 is a plurality of video A video controller for dividing the area, 56 is a video signal, 57 is a control signal, and 58 is an operation PC for selecting the area.

In FIG. 5B, the TV camera 51 captures the field of view and outputs the captured video to the video controller 55 as a video signal. The video controller 55 outputs the input video signal to the operation PC 58.
The operation PC 58 converts the video signal given from the video controller 55 to a display unit that is provided by itself or is connected separately to the display format of the display unit and outputs it. The display unit displays the entire field of view imaged by the TV camera 51.

The operator uses the input device provided in the operation PC 58 to operate the operation PC 58 (for example, GUI operation), and selects an area to be monitored. Then, the information is output to the video controller 55.
At this time, if the operator wants to display the information of the area to be displayed along with the image of the area to be displayed in characters or graphics (and further output sound), the setting can also be made. The area information includes, for example, the place name and lot number of the area (in the case of getting on and off the train, the order of the vehicle number, the entrance / exit number, etc.), time information, and the like.

  The video controller 55 divides the video of the specified area from the video of the entire field of view captured by the TV camera 51 in accordance with the instruction given from the operation PC 58, and together with the information given from the operation PC 58, the video signal 56 is output to the image distribution apparatus 52 ′. Further, the video controller 55 and the image distribution device 52 ′ exchange control signals 57 (for example, distribution request from the client PC 54, distribution control signal from the operation PC 58, etc.).

The image distribution device 52 ′ converts the video into IP packets for each frame and distributes them to the IP network 53.
The client PC 54 receives the video divided by the operation PC 58 from the video of the entire field of view captured by the TV camera 51 via the IP network 53 and displays it on the display unit.
Although FIG. 5 illustrates only one client PC, there may be a plurality of client PCs, and each may make a distribution request for another area image (including the entire image).

FIG. 6 is a diagram for explaining an embodiment of functional blocks of the video controller 52 ′ of the present invention.
In FIG. 6, the video distributor 41 is removed from the video controller of FIG. 4, and an image quality memory unit 43 is provided instead of coupling the image quality converter 48 with the video distributor 41. The image quality converter 48 and the image memory unit are provided. 43 combined.
As shown in Fig. 6, the image quality conversion unit reduces the amount of data by converting image frames (entire megapixel surveillance camera image) larger than QXGA size (2048 × 1536 dots) to VGA size (640 × 480 dots). The load on the network can be reduced.
In FIG. 6, the connection from the video controller 55 to the image distribution device 52 ′ is drawn so as to have a plurality of inputs, but in the case of FIG. 5, the connection from the video controller 55 to the image distribution device 52 is illustrated. The connection is substantially the same due to the difference in that the connections such as' are drawn as one data bus.

FIG. 7 is a block diagram for explaining an embodiment of the function of the image distribution apparatus 52 ′ of the present invention.
The web encoders 71 to 73 distribute area images to the network (in this case, three units). Further, the web encoder 74 delivers the VGA size video converted by the image quality conversion unit 48 of the video controller 55 to the network 53 for each frame.
In FIG. 7, the video controller 55 is depicted so as to have a plurality of inputs in order to clarify the internal function of the image distribution device 52 ′. To the image distribution device 52 'and so on, and the connection is drawn as a single data bus.
Each of the WEB encoders 71 to 74 delivers an area image or an entire image in response to a request from the client PC 54 side.
The control unit 75 controls the WEB encoders 71 to 74 and the switching hub 76 based on information from the video controller 55, and the switching hub 76 switches the connection between the IP network 53 and the WEB encoders 71 to 74.

In the conventional technology, since the entire video of the TV camera is directly converted into data for each frame, the amount of data per frame (QXGA size or more) is very large and the load on the network is large.
However, in the present invention, the video of the TV camera is divided into small areas for each frame and then distributed to the network. For this reason, it is possible to reduce the amount of data compared to the conventional case.
When a QXGA sized TV camera image is divided into VGA sized areas in units of frames, the data volume can be reduced to about 10% compared to the conventional method.

  Also, as can be seen from FIG. 1 ((c) to (e)) and FIG. 2 ((c) to (e), (c ′) to (e ′)), the area images are similar, and the video Is highly correlated. When encoding in MPEG format with the WEB encoder, it is possible to reduce the amount of data by sharing the I picture.

When the client PC 54 displays multiple area images, the control unit 47 detects the difference between the I picture in one area and the I picture in the other area, and the WEB encoder detects the difference between the I picture in one area and the other I picture. Distribute only area difference data (for example, P picture).
When the client PC displays one area image, it is not very effective, but when displaying multiple area images, it is only necessary to distribute the difference data of one area I picture and other areas. It is possible to reduce the amount of data.

  Note that the encoding format is not limited to the MPEG format.

  An embodiment of an area image selection method by manual selection will be described with reference to FIGS. FIG. 8 is a diagram for explaining an area image selection method according to an embodiment of the present invention. FIG. 8A shows the display area of the display unit on which an image of the entire visual field range captured by the TV camera 51 is displayed. FIG. 8B shows an enlarged image of a desired area image selected by the operator. This enlarged image is displayed on the display unit of the client PC 54, for example.

In the system shown in FIG. 5B, the entire image 81 captured by the TV camera 51 is displayed on a display unit (which can be external or internal) coupled to the operation PC 58. The operator selects a desired monitoring point from the entire image 81 on the display screen by GUI operation or the like (for example, the tip of the figure indicated by the arrow in the mouse (FIG. 8B) indicates the position of the monitoring point. )), An area image 82 centered on that portion is selected in VGA size (dotted line frame in FIG. 8 (a)). The selection method may also be to select a desired range area on the display screen by GUI operation or the like (for example, select an arbitrary range area with the mouse). At this time, since the aspect ratio of the screen display resolution such as VGA size is horizontal, the height (vertical) direction of the area detected as an intruder is mainly displayed so that all the vertical directions of the detected intruder are displayed. The size of the area is determined.
Then, the selected area image of an arbitrary size is converted into the VGA size by the image quality conversion unit of the video controller 55 and displayed as an image 83.

When the video controller 55 performs size conversion, if the number of pixels in the selected area is larger than the dot size of the display resolution of the monitor to be displayed, it is converted by thinning out, and if it is smaller, it is complemented and displayed.
The same applies to whether the image is enlarged or reduced.

FIG. 9 shows a method of automatically selecting an area by automatically detecting an intruder or the like with the image processing apparatus of the present invention. FIG. 9 is a diagram for explaining an area image selection method according to an embodiment of the present invention. FIG. 9 (a) is a diagram showing an embodiment of another system of the present invention in which an image processing unit 99 is added to the embodiment of the system of the present invention of FIG. 5 (b).
The video captured by the surveillance TV camera 51 is output to the image processing unit 99 for each frame. The image processing unit 99 detects an intruder using a known algorithm (for example, inter-frame difference or background difference). When an intruder is detected, an area that includes the intruder area centered on the detected area and that is the same as or slightly larger than the intruder area is automatically selected. The size of the area to be selected can be determined in advance or can be changed in a timely manner.

FIG. 9B is a diagram showing that the intruder automatically detected by the image processing unit 99 of the system of FIG. 9A is being tracked. 91 is an entire image captured by the TV camera 51 displayed on the display unit (external or internal) connected to the operation PC 58, 92 is the area detected at time t0, 93 is the area detected at time t2, 94 is a frame indicating the area detected at time t3. Further, reference numeral 95 in FIG. 9C denotes an enlarged image of a desired area image selected by the area frame 94. This enlarged image is displayed on the display unit of the client PC 54, for example.
That is, FIG. 9C shows that the image of the area frame 94 is converted to the VGA size by the image quality conversion unit of the video controller 55 and displayed as an image 95.

In FIG. 9 (b), frames 92 to 94 are simultaneously drawn in the entire image 91 for the sake of explanation. However, the position of the frame corresponds to the movement of the intruder as indicated by an arrow as time passes. In fact, any one is displayed at each time.
When two or more intruders are detected at the same time, a plurality of frames are displayed in the agreement. In that case, a mouse or the like is further displayed, and any intruder selected by the operator is displayed. It can be displayed in VGA size, or it can be automatically assigned to multiple client PCs and enlarged separately.

  In the above embodiment, an intruder is detected, but it is not necessary to be an intruder, and a moving body or object such as an animal or a vehicle passes or enters the camera's field of view or the sensor's alert range. Needless to say, the present invention can also be applied to the case of detecting this.

  FIG. 10 is a diagram for explaining another embodiment of the present invention, and is a diagram showing an Internet distribution image of sports broadcast such as baseball. FIG. 10 (a) is a diagram for explaining the image distribution of the baseball broadcast on the stadium. 101 is an overall image showing an image of the entire stadium taken by a TV camera. In FIG. 10 (a), the entire image 101 can be seen from the sky. However, in the dome stadium, a 360-degree camera image combined with a fisheye lens is displayed after image processing. However, it is common to take a picture so as to look down from a predetermined height on the spherical home base side. It is also possible to take a picture from the first base side or third base side of the stadium spectator seats.

102 is an area centered on the defense range of the left (left wing) player, 103 is an area centered on the defense range of the center (mid-level) player, 104 is an area centered on the defense range of the right (right) player, 105 is 106 is an area centered on the defense range of Uchino players, and 106 is an area centered on the defense range of pitchers and catchers.
In the embodiment of the invention described above, the area image selection performed on the operation PC 58 is performed by operating the client PC 54 on the WEB page (browser) of the image distribution WEB server, and the viewing monitored on the client PC 54 is performed. Select the area on the person side. The selected area is displayed on the monitor as an image 107, for example.
As shown in FIG. 11, the WEB server 111 controls the video controller 55 ′ provided in the WEB server 111 based on the selected information, and the viewer wants to watch by specifying the area to be distributed. Can deliver video.
Note that the WEB server 111 may receive the video on the camera side via the network, but directly obtains the video without passing through the network, stores the video, and transmits the video from the WEB server 111 via the network. Video may be distributed.

  For example, referring to FIG. 10, when monitoring the movement of a light player as a center, the viewer selects an area to be viewed from the entire stadium image captured by the TV camera 51 ′ on the WEB page, and The server 111 distributes the area image extracted by the video controller 55 ′ to the viewer side via the WEB encoder provided in the video controller 55 ′.

In the above embodiment, the image is picked up by a 360 degree camera, but it is not necessarily 360 degree, and any angle may be used as long as it is necessary for photographing.
The same applies to the synthesis of images captured by a plurality of cameras.

FIG. 12 is a diagram illustrating an example of a panoramic screen of 360 degrees by using three TV cameras and synthesizing images acquired by capturing 120 degrees each horizontally. FIG. 13 is a block system diagram showing an embodiment of the system configuration of the present invention when applied to a traffic flow monitoring camera system such as an urban area using the 360 degree panoramic screen of FIG.
In FIG. 12, in the camera unit 121, three TV cameras 122 are arranged so as to capture 120 degrees horizontally, and images 123-1, 123-2, and 123-3 captured by the respective TV cameras 122 are displayed. A 360-degree panoramic screen 124 is synthesized by image processing and output for display. The TV camera 122 is, for example, a megapixel camera having 9 million pixels.

  In FIG. 13, for example, a camera unit 121 capable of imaging 360 degrees is installed at the center of an intersection and monitors all directions. In addition to the method of synthesizing the three camera images, the camera 121 that monitors 360 degrees can be substituted by a 360 degree photographing camera manufactured by NSK Corporation. A plurality of camera units 121 are provided, and each camera unit 121 captures an assigned intersection.

The intersection images captured by the camera unit 121 are output to the outdoor equipment storage box 132, respectively. Each of the outdoor equipment storage boxes 132 synthesizes the input video and converts it into a 360-degree panoramic screen, and further converts it into a data format (for example, IP packet) that can be transmitted over the IP network 133. It is transmitted to the management server (WEB server) 134 via 133.
The management server 134 manages network connection terminals such as video distribution control and the number of clients to be distributed.

The client PC 135 is connected to the IP network 133 and monitors the monitoring video. Further, the WEB decoder 136 converts the image data distributed by the IP packet into, for example, an NTSC analog signal and outputs it to the large monitor 137.
The format converted by the web decoder 136 may be any format that can be displayed by the large monitor 137.
The large monitor 137 displays the input monitoring image as a single screen or multi-segment display.
Note that single-screen display displays only the video of one camera that can be input on the monitor display screen, and multi-split display displays video from multiple cameras by dividing the display screen. It is.

  In FIG. 13, a sensor (not shown) detects a change in sound, light, vibration, etc., and outputs an alarm signal 138 to the outdoor equipment storage box 132. The outdoor equipment storage box 132 responds to the alarm signal 138. , The camera image corresponding to the sensor that detected the abnormal change is displayed on a single screen, or the information for switching the screen display so that it is surrounded by a colored frame or blinking is displayed on the client via the IP network 133. Output to PC 135 or WEB decoder 136. The web decoder 136 further switches the display of the large monitor 137 according to the information.

  For example, a 360 degree monitorable camera is installed at each intersection in an urban area, and an area pre-selected on the client PC 135 side is associated with an alarm point, and a data map is created on the WEB server 134 . When an alarm occurs, the operation screen of the client PC 135 automatically switches to the screen of the area where the alarm occurred. An installed sensor and an area to be displayed when an alarm of the sensor occurs are associated in advance. In addition, there may be a plurality of corresponding areas in one sensor, or the same area may correspond to a plurality of sensors.

  FIG. 14 is an image diagram of an embodiment of the operation screen of the client PC 135 of the present invention. FIG. 14 (a) shows an abbreviated image of the operation screen displayed on the display unit 141 of the client PC 135, and the screen 142 shows a selected area (that is, an image taken by the operation target camera unit). Is displayed. Further, the entire 360 ° image of the intersection is displayed on the lower screen 143. FIG. 14B is an enlarged view of the screen 143. Furthermore, on the screen 144 on the right side, information on the selected area (intersection name, street name, address, number of alarm occurrences, alarm occurrence time, etc.) is displayed in graphics, characters, and the like. FIG. 14 (c) is an enlarged view of the screen 144.

  Each area and alarm information is converted into a data map by the WEB server 134 together with the intersection name, and the occurrence of alarm can be predicted from the time and place where the alarm occurs frequently.

Another embodiment of the present invention will be described.
FIG. 15 is a block diagram showing a monitoring system according to an embodiment of the present invention. FIG. 2 is a system diagram using an image processing apparatus and a recording apparatus for performing partial enlargement processing of an image of a subject. 521 is a TV camera, 522 is an image processing device, 522-1 is an image frame memory in the image processing device 522, 523 is a recording device, and 524 is a monitor. Reference numerals 525, 526, and 527 denote video signals. The recording device is, for example, a digital recorder. The TV camera 521 is, for example, a megapixel camera having an effective pixel count of 1.2 million pixels or more.

  In FIG. 15, a TV camera 521 captures a vehicle in a monitoring area, for example, a train stopped at a home, and outputs a video signal 525 to the image processing device 522. The image processing device 522 stores the input video signal 525 in the image frame memory 522-1 in the image processing device 522 in SXGA size (1280 × 1024 pixels) for each frame.

  The image processing device 522 partially enlarges the image stored in the image frame memory 522-1 based on the depth and shape of the image of the subject, and outputs the partially enlarged image as the video signal 526 to the recording device 523. To do. The recording device 523 records the image of the input video signal 526 in an image quality mode selected in advance.

  The image recorded with the pre-selected image quality is read out from the recording device 523 as a video signal 527 and output to the monitor 524 as a reproduced image. The monitor 524 displays a playback image of the input video signal 527 on the screen.

  The above embodiment is characterized in that the image quality does not deteriorate even when the image is enlarged. However, in order to prevent the image magnified by the image processing device 522 from deteriorating in image quality compared to a normal recorded image recorded without being magnified, pay attention to the pixel enlargement rate and the recording image quality of the recording device 523. There must be.

For example, if the recording device 523 records with VGA (640 × 480 pixels), the enlargement rate of the pixels can be enlarged up to twice as long as the image quality is not reduced in both the vertical and horizontal directions.
Also, for example, when recording in QVGA (320 × 240), if the pixel enlargement ratio is up to 4 times both vertically and horizontally, it is possible to enlarge without degrading the image quality.

  FIG. 16 is a diagram showing an example of functional blocks of the image processing apparatus 522 of the present invention. 531 is an image frame memory, 532 is an edge detection unit, 533 is a luminance difference detection unit, 534 is a subject shape detection unit, and 535 is an enlargement processing unit. FIG. 17 is a diagram schematically showing the state of an image in each component (531 to 535) in the image processing apparatus 522 in FIG. 16. 541 is an image stored in the image frame memory 531, 542 is an edge detection image detected by the edge detection unit 532, 543 is a luminance difference detection image detected by the luminance difference detection unit 533, and 544 is a subject shape detection unit 534 The shape detection image 545 detected in step 545 is an enlarged image output from the enlargement processing unit 535.

  In FIG. 16, the video signal 525 input to the image processing device 522 is stored in the image frame memory 531 as high-quality (for example, SXGA size) image data (image 541). The image frame memory 531 outputs the stored image 541 to the edge detection unit 532 and the luminance difference detection unit 533.

  The edge detection unit 532 performs edge extraction of the input image data image, and outputs the extracted edge detection image 542 to the subject shape detection unit 534. For example, in the case of an image of a home train, a train outer frame in a state where the train enters the home is detected as an edge.

  Also, the luminance difference detection unit 533 calculates a luminance value difference between the input image 541 and the background image, and generates an image (luminance difference detection image 543) using the calculated luminance value difference as a luminance value. The generated luminance difference detection image 543 is output to the subject shape detection unit 534. For example, in the case of an image of a home train, the train and the background are separated using the fact that the train surface is brighter than the background, and only the image area of the train is extracted. Note that the background image is obtained by, for example, capturing the monitoring visual field region in advance when the train is not in the line, and storing it in a predetermined memory in the image processing device 522, for example. Further, the calculation of the difference in luminance value is executed for each pixel, for example.

  The subject shape detection unit 534 determines a highly correlated partial area as a train image from the input edge detection image 542 and luminance difference detection image 543, and enlarges the image of the determined area (shape detection image 544). Output to processing unit 535.

  The enlargement processing unit 535 determines the enlargement ratio of the pixel size for each pixel in the pixel region of the shape detection image 544 determined by the subject shape detection unit 534. Then, by multiplying the determined enlargement factor by the size of each pixel, an enlarged image 545 in which the subject is viewed from the front is generated in a pseudo manner, and is output to the monitor 524 as the video signal 526. Note that the enlargement ratio is calculated under conditions where there is no change in the background and no moving object, such as an incoming train on the platform or a building premises (for example, based on the background image).

  In addition, in order to monitor passengers getting on and off near the entrance, it is necessary to monitor not only the entrance and exit but also the surrounding area. You may make it enlarge an image until.

As described above, in order to monitor a moving image in real time, the processes in FIG. 16 are all configured by hardware.
However, the image processing apparatus can be configured by an FPGA and processed as shown in the flowchart of FIG. FIG. 18 is a flowchart for explaining a processing operation example of the image processing method according to the embodiment of the present invention.

In FIG. 18, in step 1501, a reference background image is determined and stored in advance.
In step 1502, the enlargement ratio for each pixel is calculated based on the background image.
In step 551, the video signal 525 is stored in the image frame memory 531.

In step 552, the edge of the stored video signal 525 is extracted, and the edge detection image 542 is extracted.
In step 553, a difference in luminance value between the stored video signal 525 and the background image stored in advance is calculated for each pixel, for example, and a luminance difference detection image 543 is detected.

In step 554, a partial region having high correlation is determined as the shape detection image 544 from the edge detection image 542 and the luminance difference detection image 543.
In step 555-1, for the pixel region of the shape detection image 544 determined by the subject shape detection unit 534, the enlargement ratio of the pixel size of each pixel is determined.

  In step 555-2, the determined enlargement ratio for each pixel is multiplied by the size of each pixel to generate an enlarged image 545 in which the subject is viewed from the front in a pseudo manner.

  Next, an example of the procedure for calculating the enlargement ratio according to the present invention will be described with reference to FIG. FIG. 19 is a diagram for explaining the procedure for calculating the enlargement ratio according to the embodiment of the present invention. It is displayed in XY coordinates with the horizontal axis as the X axis and the vertical axis as the Y axis. The coordinate at the bottom left is the origin (0, 0). 23A shows the image 510-1 in the display example 510 of FIG. 23, FIG. 23B shows the size of the pixel before enlargement, and FIG. 23C shows the size of the pixel after enlargement. However, the size of the pixel shown in FIGS. 19B and 19C is larger than that of the image of FIG. 6A.

In FIG. 19, an image 510-1 is represented by X and Y coordinates, and the entire image 510-1 is (L _H × L _V ) = (1280 × 1024).
In order to generalize the calculation method, variables are defined as follows.

From the shape detection image 544 obtained by subject shape detection, l _H , l _V1 and l _V2 are determined as shown in FIG. Here, l _H is the X coordinate of the left end of the shape detection image 544, l _V1 is the Y coordinate of the lower left end of the shape detection image 544, and l _V2 is the Y coordinate of the upper left end of the shape detection image 544. The straight line at the bottom of the train is function F ₁ (X), and the straight line at the top of the train is function F ₂ (X).

At this time, the function F ₁ (X) can be obtained as shown in Expression (1) and the function F ₂ (X) as shown in Expression (2).

Also, the size of the original pixel is (g _X × g _Y ), the size of the enlarged pixel is (G _X × G _Y ), the magnification rate of the pixel in the Y-axis direction is α (X), and the magnification in the X-axis direction is Let β (X) be the rate.
At this time, G _Y can be obtained as shown in Equation (3).

Next, G _X can be obtained as shown in Equation (4), where S is the sum of the horizontal pixels of the enlarged image frame, where α (X) is the enlargement ratio of the pixels in the X-axis direction.

As described above, an enlarged image can be obtained by multiplying the original pixel by the enlargement ratios α (X) and β (X), which are variables of X, and enlarging each pixel.
The above calculation processing is performed in a state where the subject is photographed when the camera is installed, and the magnification rate α (X) and β (X) are used as constants without calculating the magnification rate during subsequent normal monitoring.

  Another embodiment of the present invention will be described with reference to FIG. FIG. 20 is a diagram for explaining an embodiment of the present invention of a home image monitoring system in a railway. FIG. 20 (a) shows the schematic configuration of the system as seen from above, 51-1 to 51-4 are TV cameras, and 52-1 to 52-8 are train vehicles. Illustrations of other objects such as passengers and other platforms that should be on the train are omitted in order to avoid complexity. Here, although the monitor and recording device are not shown in FIG. 7, for example, they are installed in a driver's seat, a conductor's seat, a station office, or a monitoring center, and either TV cameras 1-1 to 1-4 and either wireless or wired Alternatively, they are combined by a known transmission means (not shown, for example, wireless LAN (Local Area Network), optical communication or the like).

  FIG. 20B shows a display example of the prior art in which the images acquired by the cameras 51-1 to 51-4 in FIG. 20A are displayed as they are on a plurality of monitors. 510 'is a display example of the monitor screen, 510'-1 is a display example of displaying the video acquired by the TV camera 51-1 on one of the monitors, 510'-2 is a monitor of the video acquired by the TV camera 51-2 Display example displayed on one of the screens, 510'-3 is a display example where the video acquired by the TV camera 1-3 is displayed on one of the monitors, 510'-4 is a monitor displayed on the video acquired by the TV camera 51-4 It is the example of a display displayed on one of these.

  FIG. 20 (c) is a diagram showing an example in which videos acquired by the TV cameras 51-1 to 51-4 in FIG. 20 (a) are displayed on a plurality of monitors according to an embodiment of the present invention. 570 is a display example of the monitor screen, 570-1 is a display example in which the video acquired by the TV camera 51-1 is displayed on one of the monitors, and 570-2 is a video acquired by the TV camera 51-2 in one of the monitors. Display example, 570-3 is a display example where the video acquired by TV camera 51-3 is displayed on one of the monitors, 70-4 is a video acquired by camera 1-4 on one of the monitors It is a display example.

In the embodiment of FIG. 20, one monitoring area is imaged by a plurality of TV cameras and displayed on a plurality of monitors. For this reason, for example, as in the conventional example shown in FIG. 20B, the front and back images are alternately displayed, so that it is very difficult to view.
In such monitoring, in the present invention, the monitoring area captured by a plurality of cameras is displayed in a pseudo manner as if it was captured from the front by one camera. This improves the visibility.

  FIG. 21 illustrates another embodiment of the present invention. FIG. 21 is a diagram showing an example of a monitor display screen according to an embodiment of the present invention. FIG. 21 (c) of one embodiment of the present invention has a plurality of monitors, one monitor is assigned to each camera, and one camera assigned an image acquired by one camera is assigned. In contrast to the display on the monitor, one monitor is divided into a plurality of screens (in FIG. 7, four-divided display), and the number of monitors is reduced. 580 is a display example of the monitor screen, 570-1 is a display example in which the video acquired by the TV camera 51-1 is displayed on one of the monitors, and 570-2 is a video acquired by the TV camera 51-2 in one of the monitors. 570-3 is a display example in which the video acquired by the TV camera 51-3 is displayed on one of the monitors, and 570-4 is a video in which the TV camera 51-4 is acquired on one of the monitors. This is an example of display.

  Another embodiment of the present invention will be described with reference to FIG. FIG. 22 is a diagram showing an example of a monitor display screen according to an embodiment of the present invention. FIG. 22 is a display example 570-1 shown in FIG. 21 (c) of the embodiment of the present invention, in which the captured image of the outer wall portion of the vehicle is not displayed. It is the example of a display which displayed the upper passenger's picked-up image.

In the embodiment shown in FIG. 22, for example, a lamp (for example, a car side lamp) that notifies opening / closing of a passenger door provided on each side of the vehicle is recognized, and the lamp in the captured image is turned on by image processing. It can be executed by detecting this and calculating the position of the passenger door based on the lamp position.
Further, for example, the selection may be made by the shape detection image 544 described with reference to FIG.
Furthermore, the shape detection image 544 may be obtained by the processing in step 554 described with reference to FIG.

It is obvious that which part of the captured image is to be displayed or not to be set according to the application and purpose.
Further, the image stored in the recording apparatus may be the same as the display image, the original image, or both of them.

As described above, according to the present invention, in a surveillance camera system that monitors a subject with a depth using a plurality of cameras, a camera in which the number of effective pixels such as a megapixel camera is larger than the screen display resolution of a display device such as a monitor. You can use it to capture the entire subject and divide the captured image into multiple areas you want to monitor, so you can change the monitor image freely, and change the camera position each time you change the angle of view as before There is no need.
In addition, when the image acquired by the camera is converted into data and transmitted to an IP network or the like, the entire video is not converted into data. Therefore, only the necessary partial image, that is, the divided area is transmitted, so that the data amount can be reduced. it can.
Further, by combining the present invention with an image processing apparatus, an area around a subject such as an intruder detected can be automatically selected.

Furthermore, by applying the present invention to the Internet distribution of sports broadcasts such as baseball and soccer, it is possible to select an area that the viewer wants to watch from images obtained by capturing the entire stadium with a camera.
In addition, by applying the present invention to a traffic flow monitoring system for monitoring an intersection in an urban area, an image obtained by capturing the entire 360 ° intersection with a camera having a large number of effective pixels is divided into areas for each monitoring point. By making information and warning information into a data map, the monitor can grasp the situation of the entire intersection and simultaneously monitor the detailed image of the intersection and the image of the alarm occurrence point.

The camera arrangement | positioning of the camera system which monitors the to-be-photographed object with a some camera, and the image figure of a captured image. The figure which shows one Example of the area division | segmentation image by this invention. The block diagram which shows the structure of one Example of the system of this invention. The block diagram for demonstrating the function of the video controller of one Example of this invention. The block diagram which shows the structure of one Example of the system of this invention. The figure for demonstrating one Example of the video controller of this invention. The block diagram for demonstrating one Example of the image delivery apparatus of this invention. The figure for demonstrating the area image selection method of one Example of this invention. The figure for demonstrating the area image selection method of one Example of this invention. The figure for demonstrating one Example of this invention. The block diagram which shows the structure of one Example of the system of this invention. The figure which shows the example of a 360 degree panoramic screen using three TV cameras. The block system diagram which shows one Example of the structure of the system of this invention applied to the traffic flow monitoring camera system using the 360 degree | times panoramic screen. The image figure of one Example of the operation screen of the client PC of this invention. The block diagram which shows the monitoring system of one Example of this invention. The figure which shows one Example of the functional block of the image processing apparatus of this invention. The figure which shows typically the mode of the image in each structure part in the image processing apparatus of one Example of this invention. 6 is a flowchart for explaining a processing operation example of the image processing method according to the embodiment of the present invention. The figure for demonstrating the procedure of calculation of the expansion ratio of one Example of this invention. The figure for demonstrating one Example of this invention of the home image monitoring system in a railway. The figure which shows an example of the monitor display screen of one Example of this invention. The figure which shows an example of the monitor display screen of one Example of this invention. The figure which shows the example of a schematic structure of the conventional camera system, and the display example of a monitor screen.

Explanation of symbols

  1-1 to 1-3: TV camera, 1-11, 1-12, 1-13: Prop, 4: Train, 4-1: Leading vehicle, 4-2: Second vehicle, 4-3: Three vehicle Eyes, 20-1, 20-2, 20-3: dashed line, 31: TV camera, 32: video controller, 33: control PC, 34: monitor, 35: monitor, 41: video distributor, 42: A / D conversion unit, 43: Image memory unit, 44: Area extraction unit, 45: Image correction unit, 46: D / A conversion unit, 47: Control unit, 48: Image quality conversion unit, 51: TV camera, 52, 52 ′ : Image distribution device, 53: IP network, 54: Client PC, 55: Video controller, 56: Video signal, 57: Control signal, 58: Operation PC, 71-74: WEB encoder, 75: Control unit, 76: Switching hub, 81: Whole image, 82: Area image, 83: Image, 91: Whole image, 92, 93, 94: Frame indicating area, 95: Enlarged image, 101: Whole image, 102-106: Area, 107 : Image, 521: TV camera, 522: Image processing device, 522-1: Image frame memory, 523: Recording device, 524: Monitor, 525, 526, 527: Video signal, 531: Image frame memory, 532: Edge detection unit, 533 : Luminance difference detection unit, 534: subject shape detection unit, 535: enlargement processing unit, 541: image, 542: edge detection image, 543: luminance difference detection image, 544: shape detection image, 545: enlarged image.

Claims (5)

One or select divided area of the image or al plants constant of the one that is the image shooting area by the plurality of cameras, a display method of a camera system to be displayed on the monitor for each divided area that is the selected,
Inputting the captured image of one area as an image having a number of pixels equal to or greater than the QXGA size;
An edge detection step of extracting an edge from the input video and outputting an edge detection image;
Calculating a difference between the input video and a background image acquired in advance for each pixel, and outputting a luminance difference detection image;
A subject shape detection step of determining a highly correlated partial region from the edge detection unit and the luminance difference detection image, and outputting an image including the determined region as a shape detection image;
A depth correction step of generating a corrected image in which the subject is viewed from the front in a pseudo manner by matching the coordinates of the upper left, lower left, upper right, and lower right of the determined region with the frame shape of the subject;
Display method of a camera system Ru equipped with. The one imaged area is a station platform, the subject is a railway vehicle, and the edge detection step, the luminance difference detection step, and the subject shape detection step are in a state where the subject is photographed when the camera is installed. The corrected image obtained by correcting the input image in the depth correction step is converted into data, and transmitted through an IP network to be displayed on the monitor as the image of the divided area . Display method of the camera system. An image processing step of recognizing the position of a lamp for notifying the opening / closing of a passenger door provided on both sides of the railway vehicle from the input video is further provided, and the outer wall portion of the railway vehicle is not displayed based on the position of the lamp. 3. A display method for a camera system according to claim 2, wherein: In the display method of 請 Motomeko 1 wherein the camera system is previously associated sensors and the divided areas, if the sensor has generated the alarm has the divided areas associated with the sensors generating the alarm A display method of a camera system, wherein an image is displayed on the monitor. One or a plurality of cameras for imaging the one area, select an image or al a predetermined splitting area in one that is image pickup area, and outputs for display on the monitor for each divided area that is the selected A camera system having a control device ;
The control device extracts an edge from the input video and outputs an edge detection image; an edge detection unit;
A luminance difference detection unit that calculates a difference with a background image acquired in advance for each pixel and outputs a luminance difference detection image;
A subject shape detection unit that determines a highly correlated partial region from the edge detection unit and the luminance difference detection image, and outputs an image including the determined region as a shape detection image;
An enlargement processing unit that generates an enlarged image in which the subject is viewed from the front in a pseudo manner by matching the coordinates of the upper left, lower left, upper right, and lower right of the determined region with the frame shape of the subject,
Camera system video one area that is the imaging, which has a number of or more pixels QXGA size, and having a screen display resolution greater than the resolution of the monitor.

Images