TW202110164A - Image processing device and method thereof - Google Patents

Abstract

An image processing device is disclosed. The image processing device includes an image sensing module. The image sensing module includes a wide-angle lens, an image sensing unit, and an image processing unit. The image sensing unit receives light through the wide-angle lens to generate a raw image. The image processing unit processes the raw image to generate a wide-angle image. The image processing unit obtains a region of interest according to a predetermined algorithm, and generates a zoom image from the wide-angle image according to the region of interest.

Description

Image processing device and method

The invention relates to an image processing device, in particular to a device and method that utilizes a single lens and a single image sensing device to simultaneously generate a wide-angle image and a zoomed-in image.

In the prior art, to obtain a wide-angle image and a zoom-in image, two sets of lenses and image sensing units are usually used to generate the wide-angle image and the zoom-in image respectively. For example, today's mobile phones often use dual-lens and dual-image sensing units to achieve both wide-angle and zoom-in images. One of the lenses is a wide-angle lens to generate wide-angle images, and the other is a zoom-in lens to generate zoomed-in images. However, this design method will cause the complexity of the mechanism design, thereby increasing the overall cost.

A first embodiment of the present invention provides an image processing device. The image processing device includes an image sensing module including a lens for collecting light; an image sensing unit that collects light by the lens to generate an original image; and an image processing unit; wherein the image processing The unit processes the original image to generate a first image; the image processing unit obtains a region of interest according to a predetermined algorithm, and generates a second image from the original image or the first image according to the region of interest.

A second embodiment of the present invention provides an image processing device. The image processing device includes a lens for collecting light; an image sensing unit collects light by the lens, and generates a first original image and a second exposure time according to a first exposure time and a second exposure time, respectively Two original images; and an image processing unit; wherein the image processing unit processes the first original image to generate a first image, and adjusts the first image according to the brightness distribution value of a first predetermined area of the first original image Exposure time; the image processing unit obtains a region of interest according to a preset algorithm, and generates a second image from the second original image according to the region of interest, and according to one of the regions of interest of the second original image The brightness distribution value of the second predetermined area is adjusted for the second exposure time.

A third embodiment of the present invention provides an image processing method. The image processing method includes generating an original image through a lens and an image sensing unit; processing the original image through an image processing unit to generate a first image; using the image processing unit, according to a predetermined algorithm, the original image Obtaining a region of interest from the image or the first image; and using the image processing unit to generate a second image from the original image based on the region of interest.

A fourth embodiment of the present invention provides an image processing method. The image processing method includes generating a first original image and a second original image through a lens and an image sensing unit according to a first exposure time and a second exposure time; processing the first image through an image processing unit An original image to generate a first image; through the image processing unit, according to a predetermined algorithm, the second original image obtains a region of interest; and through the image processing unit, according to the region of interest, from the second The original image generates a second image; wherein the image processing unit adjusts the first exposure time according to the brightness distribution value of a first predetermined area of the first original image, and adjusts the first exposure time according to the area of interest of the second original image The brightness distribution value of a second predetermined area is adjusted for the second exposure time.

Please refer to Figure 1. Fig. 1 illustrates a schematic diagram of an image processing apparatus 100 according to a first embodiment of the present invention. The image processing device 100 includes a mobile lighting module 110 and an image sensing device 120. The mobile lighting module 110 includes a lighting unit 111 and a mobile module 112. The mobile module 112 includes a mobile pan-tilt 1121 and a controller 1122. The mobile head 1121 can be a tripod head, horizontal head, spherical head... etc. The moving pan/tilt 1121 moves or rotates the lighting unit 111 to illuminate the specific area X according to the controller 1122. The image sensing module 120 includes a lens 121, an image sensing unit 122, and an image processing unit 123. The lens 121 may be a wide-angle lens. The image sensing unit 122 collects light through the lens 121 to generate an original image IR.

The image processing unit 123 processes the original image IR to generate a wide-angle image IW. According to a predetermined algorithm, a region of interest (ROI) can be obtained from the original image IR or the wide-angle image IW. For example, a predetermined area can be used to generate the area of interest, or the area corresponding to one or more objects that meet specific requirements can also be used as the area of interest. The specific requirement may be that the size of the moving object is within an object size range, the moving speed of the object is within a moving speed range, the object moves in a specific direction, or the object is recognized as a range of a predetermined category. The information of the area of interest can be transmitted to the controller 1122 of the mobile module 112 to obtain the specific area X, so that the mobile platform 1121 can move or rotate the lighting unit 111 according to the controller 1122 to illuminate the specific area X. In an embodiment, the specific area X may be similar to or the same as the area of interest. In this way, for example, if there is an object of interest in the sensing range of the image sensor module 120, the image sensor module 120 detects the object and can generate the area of interest accordingly. The position and size of the area of interest are transmitted to the mobile lighting module 110 to move or rotate the lighting position to the object of interest to illuminate the object of interest.

More specifically, the image processing unit 123 processes the original image IR to generate a wide-angle image IW, and according to the predetermined algorithm, can obtain the region of interest from the original image IR or the wide-angle image IW, where the region of interest is the object The area where it is located can also be a specific area X.

For example, when the predetermined algorithm is set to a moving speed range and the moving speed of an object is within the moving speed range, the image processing unit 123 obtains the region of interest from the original image IR or the wide-angle image IW according to the predetermined algorithm, The area of interest is the area where the object is located. When the predetermined algorithm is set to an object size range and the size of a moving object is within the object size range, the image processing unit 123 processes the original image IR to generate a wide-angle image IW, and according to the predetermined algorithm, from the original image IR or The wide-angle image IW obtains the area of interest, where the area of interest is the area where the object is located. Alternatively, when the predetermined algorithm is set to a moving direction range and the moving direction of an object is within the moving direction range, the image processing unit 123 can obtain the region of interest from the original image IR or the wide-angle image IW according to the predetermined algorithm , Where the area of interest is the area where the object is located. Or, when the predetermined algorithm is set to a range of a predetermined category, and an object is recognized as belonging to the range of the category (for example: a person/vehicle/animal), the image processing unit 123 processes the original image IR to generate a wide-angle image IW , And according to the predetermined algorithm, the area of interest can be obtained from the original image IR or the wide-angle image IW, where the area of interest is the area where the object is located. Or, when the predetermined algorithm is set as an object tracking algorithm, the motion vectors of a plurality of blocks can be obtained from the wide-angle image IW, and the blocks whose motion vectors of the plurality of blocks belong to the range of the same direction can be grouped separately. Grouping: When the size of the area connected by the grouped blocks is within a range, the position and size of an object of interest can be obtained from the original image IR or the wide-angle image IW as the area of interest.

Then, the information of the area of interest can be transmitted to the controller 1122 of the movement module 112 to obtain the specific area X, so that the mobile platform 1121 can move or rotate the lighting unit 111 according to the controller 1122 to illuminate the specific area X.

In one embodiment, the image processing unit 123 additionally generates a zoom-in image IZ according to the region of interest. The image processing unit 123 synthesizes the wide-angle image IW and the zoom-in image IZ into a display image ID. The display image ID can be, for example, a splicing of the wide-angle image IW and the zoom-in image IZ, or a sub-original image (the original image is the zoom-in image IZ, the sub-image is the wide-angle image IW, and vice versa). Or, the display image ID is two images, one is the wide-angle image IW and the other is the zoom-in image IZ. The display image ID can be used to display on a display device. In addition, there may be a plurality of regions of interest. For example, in the wide-angle image IW, there may be a first region of interest ROI1 and a second region of interest ROI2, which means that two objects are detected in the wide-angle image IW. Accordingly, the image processing unit 123 generates a first zoom-in image IZ1 and a second zoom-in image IZ2.

In the prior art, to obtain a wide-angle image and a zoom-in image, two independent lenses and image sensing units are required in the image sensing module to obtain the wide-angle image IW and the zoom-in image IZ respectively. In other words, in the prior art, the image sensing unit requires a wide-angle lens and a corresponding image sensing unit to generate a wide-angle image, and at the same time, a zoom-in lens and a corresponding image sensing unit are required to generate a zoomed-in image. Compared with the prior art, in the present invention, the zoomed-in image IZ can be generated by the wide-angle image IW in the original image IR generated by the wide-angle lens 121 and the image sensing unit 122 through the image processing unit 123. Thus, the present invention The image sensing module 120 only needs a set of lens and image sensing unit, which saves a lot of cost.

In another embodiment, the image sensing module 120 further includes a moving module 124. The mobile module 124 includes a mobile PTZ 1241 and a controller 1242. The moving pan/tilt 1241 moves or rotates the lens 121 and the image sensing unit 122 according to the controller 1242. For example, the information of the area of interest can be transmitted to the controller 1242 of the movement module 124, and then the moving pan/tilt 1241 can move or rotate the lens 121 and the image sensing unit 122 accordingly. For example, when the area of interest is about to leave the field of view of the lens 121, the moving pan/tilt 1241 can move or rotate the lens 121 and the image sensing unit 122 to keep the area of interest within the field of view of the lens 121.

Furthermore, before synthesizing the wide-angle image IW and the zoom-in image IZ into the display image ID, the wide-angle image IW and the zoom-in image IZ are first subjected to dewarp processing. During the correction process, the correction formulas and parameters for the wide-angle image IW and the zoom-in image IZ can be set to be the same or different according to the needs of the user. In addition, the wide-angle image IW can be generated at a first frame rate, and the zoom-in image IZ can be generated at a second frame rate, where the first and second frame rates can be the same or different.

For example, when the predetermined algorithm is set to a predetermined speed range and the moving speed of an object is within the predetermined speed range, the image processing unit 123 processes the original image IR to generate a wide-angle image IW, and according to the predetermined algorithm, The area of interest can be obtained from the original image IR or the wide-angle image IW, where the area of interest is the area where the object is located. The image processing unit 123 additionally generates a zoom-in image IZ according to the region of interest. Alternatively, when the predetermined algorithm is set to an object size range, and a moving object size is within the object size range, the image processing unit 123 processes the original image IR to generate a wide-angle image IW, and according to the predetermined algorithm, obtains a wide-angle image IW from the original image IR or wide-angle image IW can get the area of interest, where the area of interest is the area where the object is located. The image processing unit 123 additionally generates a zoom-in image IZ according to the region of interest. Or, when the predetermined algorithm is set to a moving direction range and the moving direction of an object is within the moving direction range, the image processing unit 123 processes the original image IR to generate a wide-angle image IW, and according to the predetermined algorithm, from the original Image IR or wide-angle image IW can get the area of interest, where the area of interest is the area where the object is located. The image processing unit 123 additionally generates a zoom-in image IZ according to the region of interest. Or, when the predetermined algorithm is set to a range of a predetermined category, and an object is recognized as belonging to the range of the category (for example: a person/vehicle/animal), the image processing unit 123 processes the original image IR to generate a wide-angle image IW , And according to the predetermined algorithm, the area of interest can be obtained from the original image IR or the wide-angle image IW, where the area of interest is the area where the object is located. The image processing unit 123 additionally generates a zoom-in image IZ according to the region of interest. Or, when the predetermined algorithm is set as an object tracking algorithm, the motion vectors of a plurality of blocks can be obtained from the wide-angle image IW, and the blocks whose motion vectors of the plurality of blocks belong to the range of the same direction can be grouped separately. Grouping: When the size of the area connected by the grouped blocks is within a range, the position and size of an object of interest can be obtained from the original image IR or the wide-angle image IW as the area of interest.

It can be seen from the above that the area of interest is usually a moving object, so a higher frame rate is required, that is, when the zoomed-in image IZ is compressed, it will be compressed at a higher frame rate. The wide-angle image IW contains more background parts, most of which are still, so a lower frame rate can be used, which means that when the wide-angle image is compressed, it will be compressed at a lower frame rate.

In addition, the image sensor module 120 further includes an output unit 125. The output unit 125 compresses and displays the image ID according to a predetermined algorithm to reduce the transmission bit rate. The predetermined algorithm may be, for example, H.264 or H.265 or others. The compressed display image ID can be transmitted to a display device, and the display device decompresses the display image ID and displays it.

In addition, the image processing unit 123 controls the exposure time of the image sensing unit 122 according to the original image IR. The exposure time of the image sensing unit 122 may be a preset value. More specifically, the image processing unit 123 adjusts the exposure time of the image sensing unit 122 according to the brightness statistical value of a predetermined area of the original image IR. For example, when the brightness statistical value of a predetermined area of the original image IR is too high, it means that the entire range of the original image IR is too bright, and the image processing unit 123 reduces the exposure time of the image sensing unit 122; when the original image IR The brightness statistical value of a predetermined area is too low, which means that the entire range of the original image IR is too dark, and the image processing unit 123 will increase the exposure time of the image sensing unit 122. However, in this method, since the IR field of view of the entire original image and the adjusted exposure time are considered, it may additionally cause the image of the area of interest to be too bright or too dark. For example, when the brightness statistical value of a predetermined area of the original image IR is higher, and the brightness statistical value of a predetermined area of the original image IR is lower, it means that the background in the original image IR is brighter and the area of interest Darker. At this time, the image processing unit 123 lowers the exposure time of the image sensing unit 122 so that the background in the original image IR meets the predetermined brightness, but this will cause the image of the region of interest to be too dark. Conversely, when the luminance statistical value of a predetermined area of the original image IR is low, and the luminance statistical value of a predetermined area of the original image IR is higher, it means that the background in the original image IR is darker, and the area of interest image is lower. bright. At this time, the image processing unit 123 increases the exposure time of the image sensing unit 122 so that the background in the original image IR meets the predetermined brightness, but this will cause the image of the area of interest to be too bright. Therefore, the present invention proposes to provide different exposure times for the original image IR and the attention area image according to the brightness statistics of a predetermined area image of the original image IR and the attention area image, so that the original image IR and the attention area image are provided with different exposure times. The brightness of the image can meet the predetermined brightness. For example, the image processing unit 123 may control the exposure time of the image sensing unit 122 according to a predetermined area of the first N original images IR to generate the (N+X)th wide-angle image IW; at the same time, the image processing unit 123 can control the exposure time of the image sensing unit 122 according to a predetermined area of the focus area of the first M original images IR to generate the (M+Y)th zoom-in image IZ. For example, when N=M, X=1, Y=2, the exposure time of the image sensing unit 122 to the original image IR(N+1) is T(N+1); the image sensing unit 122 is The exposure time of the original image IR(N+2) is T(N+2); where the exposure time T(N+1) is adjusted according to the brightness statistics of a predetermined area of the first N original images IR; the exposure time T(N+2) is adjusted according to the brightness statistics of a predetermined area of one of the focus areas of the first N original images IR. In this way, a wide-angle image IW(N+1) that meets the predetermined brightness and a zoomed-in image IZ(N+2) that meets the predetermined brightness can be obtained.

Please refer to Figure 2. Figure 2 illustrates a schematic diagram of an image processing device 200 according to a second embodiment of the present invention. The image processing device 200 includes an image sensing device 220. The image sensing module 220 includes a lens 221, an image sensing unit 222, and an image processing unit 223. The lens 221 may be a wide-angle lens. The image sensing unit 222 collects light through the lens 221 to generate an original image IR. The image processing unit 223 processes the original image IR to generate a wide-angle image IW. According to a predetermined algorithm, a region of interest (ROI) can be obtained from the original image IR or the wide-angle image IW.

For example, a predetermined area can be used to generate the area of interest, or the area corresponding to one or more objects that meet specific requirements can also be used as the area of interest. The specific requirement can be that the moving speed of the object is within a moving speed range, the object moves in a specific direction, or the object is recognized as a range of a predetermined category.

In one embodiment, the image processing unit 223 additionally generates a zoom-in image IZ from the wide-angle image IW according to the region of interest. The image processing unit 223 synthesizes the wide-angle image IW and the zoom-in image IZ into a display image ID. The display image ID can be, for example, a splicing of the wide-angle image IW and the zoom-in image IZ, or a sub-original image (the original image is the zoom-in image IZ, the sub-image is the wide-angle image IW, and vice versa). Or, the display image ID is two images, one is the wide-angle image IW and the other is the zoom-in image IZ. The display image ID can be used to display on a display device. In addition, there may be a plurality of regions of interest. For example, in the wide-angle image IW, there may be a first region of interest ROI1 and a second region of interest ROI2, which means that two objects are detected in the wide-angle image IW. Accordingly, the image processing unit 223 generates a first zoom-in image IZ1 and a second zoom-in image IZ2 from the original image IR.

In the prior art, to obtain a wide-angle image and a zoom-in image, two independent lenses and image sensing units are required in the image sensing module to obtain the wide-angle image IW and the zoom-in image IZ respectively. In other words, in the prior art, the image sensing unit requires a wide-angle lens and a corresponding image sensing unit to generate a wide-angle image, and at the same time, a zoom-in lens and a corresponding image sensing unit are required to generate a zoomed-in image. Compared with the prior art, in the present invention, the zoom-in image IZ can be generated by the wide-angle lens 221 and the wide-angle image IW in the original image IR generated by the image sensing unit 222 through the image processing unit 223. Thus, the present invention The image sensing module 220 only requires a set of lens and image sensing unit, which saves a lot of cost.

In another embodiment, the image sensing module 220 further includes a moving module 224. The mobile module 224 includes a mobile PTZ 2241 and a controller 2242. The moving pan/tilt 2241 moves or rotates the lens 221 and the image sensing unit 222 according to the controller 2242. For example, the information of the area of interest can be transmitted to the controller 2242 of the moving module 224, and then the moving pan/tilt 2241 can move or rotate the lens 221 and the image sensing unit 222 accordingly. For example, when the area of interest is about to leave the field of view of the lens 121, the moving pan/tilt 1241 can move or rotate the lens 121 and the image sensing unit 122 to keep the area of interest within the field of view of the lens 121.

Furthermore, before synthesizing the wide-angle image IW and the zoom-in image IZ into the display image ID, the wide-angle image IW and the zoom-in image IZ are first subjected to dewarp processing. During the correction process, the correction formulas and parameters for the wide-angle image IW and the zoom-in image IZ can be set to be the same or different according to the needs of the user. In addition, the wide-angle image IW can be generated at a first frame rate, and the zoom-in image IZ can be generated at a second frame rate, where the first and second frame rates can be the same or different.

For example, when the predetermined algorithm is set to a predetermined speed range and the moving speed of an object is within the predetermined speed range, the image processing unit 223 processes the original image IR to generate a wide-angle image IW, and according to the predetermined algorithm, The area of interest can be obtained from the original image IR or the wide-angle image IW, where the area of interest is the area where the object is located. The image processing unit 223 additionally generates a zoomed-in image IZ according to the area of interest. Or, when the predetermined algorithm is set to an object size range, and a moving object size is within the object size range, the image processing unit 223 processes the original image IR to generate a wide-angle image IW, and according to the predetermined algorithm, obtains a wide-angle image from the original image IR or wide-angle image IW can get the area of interest, where the area of interest is the area where the object is located. The image processing unit 223 additionally generates a zoomed-in image IZ according to the area of interest. Or, when the predetermined algorithm is set to a moving direction range, and the moving direction of an object is within the moving direction range, the image processing unit 223 processes the original image IR to generate a wide-angle image IW, and according to the predetermined algorithm, from the original Image IR or wide-angle image IW can get the area of interest, where the area of interest is the area where the object is located. The image processing unit 223 additionally generates a zoomed-in image IZ according to the area of interest. Or, when the predetermined algorithm is set to a range of a predetermined category, and an object is recognized as belonging to the range of the category (for example: a person/vehicle/animal), the image processing unit 223 processes the original image IR to generate a wide-angle image IW , And according to the predetermined algorithm, the area of interest can be obtained from the original image IR or the wide-angle image IW, where the area of interest is the area where the object is located. The image processing unit 223 additionally generates a zoomed-in image IZ according to the area of interest. Or, when the predetermined algorithm is set as an object tracking algorithm, the motion vectors of a plurality of blocks can be obtained from the wide-angle image IW, and the blocks whose motion vectors of the plurality of blocks belong to the range of the same direction can be grouped separately. Grouping: When the size of the area connected by the grouped blocks is within a range, the position and size of an object of interest can be obtained from the original image IR or the wide-angle image IW as the area of interest.

It can be seen from the above that the area of interest is usually a moving object, so a higher frame rate is required, that is, when the zoomed-in image IZ is compressed, it will be compressed at a higher frame rate. The wide-angle image IW contains more background parts, most of which are still, so a lower frame rate can be used, which means that when the wide-angle image is compressed, it will be compressed at a lower frame rate.

In addition, the image sensing module 220 further includes an output unit 225. The output unit 225 compresses and displays the image ID according to a predetermined algorithm to reduce the transmission bit rate. The predetermined algorithm may be, for example, H.264 or H.265 or others. The compressed display image ID can be transmitted to a display device, and the display device decompresses the display image ID and displays it.

In addition, the image processing unit 223 controls the exposure time of the image sensing unit 222 according to the original image IR. The exposure time of the image sensing unit 222 may be a preset value. More specifically, the image processing unit 223 adjusts the exposure time of the image sensing unit 222 according to the brightness statistical value of a predetermined area of the original image IR. For example, when the brightness statistical value of a predetermined area of the original image IR is too high, it means that the entire range of the original image IR is too bright, and the image processing unit 223 reduces the exposure time of the image sensing unit 222; when the original image IR The brightness statistical value of a predetermined area is too low, which means that the entire range of the original image IR is too dark, and the image processing unit 223 will increase the exposure time of the image sensing unit 222. However, in this method, since the IR field of view of the entire original image and the adjusted exposure time are considered, it may additionally cause the image of the area of interest to be too bright or too dark. For example, when the brightness statistical value of a predetermined area of the original image IR is higher, and the brightness statistical value of a predetermined area of the original image IR is lower, it means that the background in the original image IR is brighter and the area of interest Darker. At this time, the image processing unit 223 lowers the exposure time of the image sensing unit 222 so that the background in the original image IR meets the predetermined brightness, but this will cause the image of the region of interest to be too dark. Conversely, when the luminance statistical value of a predetermined area of the original image IR is low, and the luminance statistical value of a predetermined area of the original image IR is higher, it means that the background in the original image IR is darker, and the area of interest image is lower. bright. At this time, the image processing unit 223 increases the exposure time of the image sensing unit 222 so that the background in the original image IR meets the predetermined brightness, but this will cause the image of the region of interest to be too bright. Therefore, the present invention proposes to provide different exposure times for the original image IR and the attention area image according to the brightness statistics of a predetermined area image of the original image IR and the attention area image, so that the original image IR and the attention area image are provided with different exposure times. The brightness of the image can meet the predetermined brightness. For example, the image processing unit 223 may control the exposure time of the image sensing unit 222 according to a predetermined area of the first N original images IR to generate the (N+X)th wide-angle image IW; at the same time, the image processing unit 223 may control the exposure time of the image sensing unit 222 according to one of the predetermined areas of the focus area of the first M original images IR to generate the (M+Y)th zoom-in image IZ. For example, when N=M, X=1, Y=2, the exposure time of the image sensing unit 222 to the original image IR(N+1) is T(N+1); the image sensing unit 222 is The exposure time of the original image IR(N+2) is T(N+2); where the exposure time T(N+1) is adjusted according to the brightness statistics of a predetermined area of the first N original images IR; the exposure time T(N+2) is adjusted according to the brightness statistics of a predetermined area of one of the focus areas of the first N original images IR. In this way, a wide-angle image IW(N+1) that meets the predetermined brightness and a zoomed-in image IZ(N+2) that meets the predetermined brightness can be obtained. The foregoing descriptions are only preferred embodiments of the present invention, and all equivalent changes and modifications made in accordance with the scope of the patent application of the present invention should fall within the scope of the present invention.

100,200: image processing device 110: Mobile lighting module 120, 220: image sensing device 111: lighting unit 112: mobile module 1121,1241,2241: Mobile PTZ 1122, 1242, 2242: Controller 121,221: lens 122, 222: Image sensor unit 123,223: image processing unit 124,224: mobile module 125, 225: output unit ID: Display image IR: Original image IW: Wide-angle image IZ: zoom in image ROI: area of interest

Fig. 1 illustrates a schematic diagram of the image processing device according to the first embodiment of the present invention. Figure 2 illustrates a schematic diagram of an image processing device according to a second embodiment of the present invention.

100: Image processing device

110: Mobile lighting module

120: Image sensing device

111: lighting unit

112: mobile module

1121,1241: Mobile PTZ

1122, 1242: Controller

121: lens

122: Image sensor unit

123: image processing unit

124: Mobile Module

125: output unit

ID: Display image

IR: Original image

IW: Wide-angle image

IZ: zoom in image

ROI: area of interest

Claims (12)

An image processing device, including: An image sensing module, including: A lens to collect light; An image sensing unit that collects light through the lens to generate an original image; and An image processing unit; The image processing unit processes the original image to generate a first image; the image processing unit obtains a region of interest according to a predetermined algorithm, and generates a first image from the original image or the first image according to the region of interest Two images. An image processing device, including: A lens to collect light; An image sensing unit that collects light through the lens and generates a first original image and a second original image according to a first exposure time and a second exposure time; and An image processing unit; The image processing unit processes the first original image to generate a first image, and adjusts the first exposure time according to the brightness distribution value of a first predetermined area of the first original image; the image processing unit adjusts the first exposure time according to a preset Set up an algorithm to obtain a region of interest, generate a second image from the second original image according to the region of interest, and adjust according to the brightness distribution value of a second predetermined region of the region of interest of the second original image The second exposure time. The image processing device according to claim 1 or 2, wherein the lens is a wide-angle lens, the first image is a wide-angle image; the second image is a zoom-in image; the wide-angle image is generated at a first frame rate; The zoomed-in image is generated at a second frame rate; the first frame rate is less than the second frame rate. The image processing device according to claim 1 or 2, wherein when the preset algorithm is a moving speed range, and the moving speed of an object is within the moving speed range, a position information of the object is used as the area of interest; when The default algorithm is an object size range, and when the object size is within the object size range, the position information of the object is used as the area of interest; when the default algorithm is a moving direction range and the object moving direction When in the range of the moving direction, the position information of the object is taken as the area of interest; when the preset algorithm is a range of a predetermined type, and the object belongs to the range of the predetermined type, the position information of the object is taken as the area of interest The area of interest; when the default algorithm is set as an object tracking algorithm, the motion vectors of a plurality of blocks can be obtained from the first image, and the motion vectors of the plurality of blocks belong to the area in the same direction Blocks can be grouped. When the size of the area connected by the grouped blocks is within a range, the position and size of an object of interest can be obtained as the area of interest. The image processing device according to claim 1 or 2, wherein the image sensing module further includes: A mobile module, including: A mobile pan/tilt; and A controller for receiving information about the area of interest; The controller controls the mobile pan-tilt to move or rotate the lens and the image sensing unit according to the information of the area of interest. The image processing device according to claim 1 or 2, further comprising: A mobile lighting module, including: A lighting unit; and A mobile module, including: A mobile pan/tilt; and A controller for receiving information about the area of interest; The controller controls the mobile platform to move or rotate the lighting unit according to the information of the area of interest. An image processing method, including: Generating an original image through a lens and an image sensing unit; Processing the original image through an image processing unit to generate a first image; Through the image processing unit, according to a predetermined algorithm, the original image or the first image obtains a region of interest; and Through the image processing unit, a second image is generated from the original image according to the region of interest. An image processing method, including: Through a lens and an image sensing unit, a first original image and a second original image are respectively generated according to a first exposure time and a second exposure time; Processing the first original image through an image processing unit to generate a first image; Through the image processing unit, according to a predetermined algorithm, the second original image obtains a region of interest; and Through the image processing unit, a second image is generated from the second original image according to the region of interest; The image processing unit adjusts the first exposure time according to the brightness distribution value of a first predetermined area of the first original image, and adjusts the first exposure time according to the brightness distribution value of a second predetermined area of the attention area of the second original image , Adjust the second exposure time. The image processing method according to claim 7 or 8, wherein the lens is a wide-angle lens, the first image is a wide-angle image; the second image is a zoom-in image; the wide-angle image is generated at a first frame rate; The zoomed-in image is generated at a second frame rate; the first frame rate is less than the second frame rate. The image processing method according to claim 7 or 8, wherein when the predetermined algorithm is a moving speed range, and the moving speed of an object is within the moving speed range, the position information of the object is used as the area of interest; when The default algorithm is an object size range, and when the object size is within the object size range, the position information of the object is used as the area of interest; when the default algorithm is a moving direction range and the object moving direction When in the range of the moving direction, the position information of the object is taken as the area of interest; when the preset algorithm is a range of a predetermined type, and the object belongs to the range of the predetermined type, the position information of the object is taken as the area of interest The area of interest; when the default algorithm is set as an object tracking algorithm, the motion vectors of a plurality of blocks can be obtained from the first image, and the motion vectors of the plurality of blocks belong to the area in the same direction Blocks can be grouped. When the size of the area connected by the grouped blocks is within a range, the position and size of an object of interest can be obtained as the area of interest. The image processing method described in claim 7 or 8, further including: Through a moving module, move or rotate the lens and the image sensing unit according to the information of the area of interest; The mobile module includes a mobile pan-tilt and a controller; the controller controls the mobile pan-tilt to move or rotate the lens and the image sensing unit according to the information of the region of interest. The image processing method described in claim 7 or 8, further including: Through a mobile lighting module, move or rotate the mobile lighting module according to the information of the area of interest; The mobile lighting module includes a mobile pan/tilt, a lighting unit, and a controller; the controller controls the mobile pan/tilt to move or rotate the lighting unit according to the information of the area of interest.

Images