CN104378582A - Intelligent video analysis system and method based on PTZ video camera cruising - Google Patents
Intelligent video analysis system and method based on PTZ video camera cruising Download PDFInfo
- Publication number
- CN104378582A CN104378582A CN201310359688.8A CN201310359688A CN104378582A CN 104378582 A CN104378582 A CN 104378582A CN 201310359688 A CN201310359688 A CN 201310359688A CN 104378582 A CN104378582 A CN 104378582A
- Authority
- CN
- China
- Prior art keywords
- cruising
- module
- target
- detection
- tilt
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000004458 analytical method Methods 0.000 title claims abstract description 74
- 238000000034 method Methods 0.000 title claims abstract description 43
- 238000001514 detection method Methods 0.000 claims abstract description 80
- 238000004422 calculation algorithm Methods 0.000 claims abstract description 48
- 230000008878 coupling Effects 0.000 claims description 25
- 238000010168 coupling process Methods 0.000 claims description 25
- 238000005859 coupling reaction Methods 0.000 claims description 25
- 230000003287 optical effect Effects 0.000 claims description 16
- 239000011159 matrix material Substances 0.000 claims description 15
- 230000008859 change Effects 0.000 claims description 13
- 230000006870 function Effects 0.000 claims description 13
- 238000006243 chemical reaction Methods 0.000 claims description 11
- 238000005352 clarification Methods 0.000 claims description 10
- 230000009467 reduction Effects 0.000 claims description 10
- 230000009466 transformation Effects 0.000 claims description 10
- 238000000605 extraction Methods 0.000 claims description 8
- 238000012549 training Methods 0.000 claims description 8
- 239000000284 extract Substances 0.000 claims description 7
- 238000001914 filtration Methods 0.000 claims description 6
- 230000006978 adaptation Effects 0.000 claims description 5
- 238000004364 calculation method Methods 0.000 claims description 5
- 239000013558 reference substance Substances 0.000 claims description 5
- 238000007781 pre-processing Methods 0.000 claims description 3
- 238000012544 monitoring process Methods 0.000 description 16
- 230000008569 process Effects 0.000 description 7
- 230000003542 behavioural effect Effects 0.000 description 5
- 230000008901 benefit Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 238000012545 processing Methods 0.000 description 4
- 238000012163 sequencing technique Methods 0.000 description 4
- 239000000779 smoke Substances 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 4
- 238000012706 support-vector machine Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 238000009826 distribution Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000003384 imaging method Methods 0.000 description 2
- 230000013011 mating Effects 0.000 description 2
- 238000003909 pattern recognition Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 238000005520 cutting process Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000004438 eyesight Effects 0.000 description 1
- 230000001815 facial effect Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 230000004301 light adaptation Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000003595 mist Substances 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 238000011946 reduction process Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- 230000007306 turnover Effects 0.000 description 1
Landscapes
- Closed-Circuit Television Systems (AREA)
Abstract
The invention provides an intelligent video analysis system and method based on PTZ video camera cruising. The system comprises a front-end PTZ video camera and a rear-end server. The rear-end server comprises a cruising configuration module, a PTZ video camera control module, a video analysis configuration module, a system control module, an intelligent video analysis module and an alarm management module. The cruising configuration module is used for setting cruising groups and cruising points of the system to generate a cruising list. The PTZ video camera control module is used for analyzing the cruising list and generating a cruising execution list automatically. The video analysis configuration module is used for configuring related intelligent video analytical algorithms for all the cruising points and configuring the cruising points into the cruising list. The system control module is used for calibrating video camera parameters of each cruising point, calling a video stitching module and automatically generating a panorama splicing map in the whole cruising period according to the execution sequence of the cruising points. The intelligent video analysis module is used for conducting target detection and event analysis according to related setting and giving a real-time alarm to a detected event. The alarm management module is used for conducting corresponding local management on the alarm.
Description
Technical field
The invention belongs to video monitoring, video analysis, area of pattern recognition, especially relate to a kind of intelligent video analysis system and method cruised based on Pan/Tilt/Zoom camera.
Background technology
Video monitoring is the important component part of safety and protection system, and along with the development of Video Supervision Technique, video camera has been widely used for monitoring in real time various environment, region and place.Because Pan/Tilt/Zoom camera has the advantage such as variable visual angle and variable focal length compared to fixed cameras, have that monitoring scene is larger, tracking target is wider, obtained applying more and more widely.
Pan/Tilt/Zoom camera tracking technique is that one utilizes image processing techniques, and realize target finds and control Pan/Tilt/Zoom camera to position in certain scene domain moving target, the monitoring technique followed the tracks of and capture.This technology may be used for monitoring road conditions, public place security monitoring, multiple field such as forest fire protection.But in current monitoring field, a normally video camera only responsible region oneself monitored, and although every platform Pan/Tilt/Zoom camera can move, but monitoring range is still very limited, because the informational needs of PTZ tri-variablees of Pan/Tilt/Zoom camera places one's entire reliance upon the feedback of track algorithm in tracing process, be difficult to control Pan/Tilt/Zoom camera accurately, and at present automatically PTZ track algorithm to Small object and environmental suitability poor, at present also cannot popularization and application on a large scale.
Based on the target detection track algorithm relative maturity of still camera, but because the view field of single camera is limited, larger monitoring visual field needs multiple video camera could realize covering, in the Target Tracking System of reality, more employing multi-camera systems, inevitably to add the cost of Iarge-scale system when budget is certain or reduce the quality of video camera, and fix due to camera scene, in order to the visual field taking into account video camera covers, intelligent video analysis algorithm generally cannot obtain the minutia detecting target, as the license board information of the vehicle of the facial information and tracking that obtain the people of tracking.
In view of introduction before, we find that system common is at present the automatic tracking system of base Pan/Tilt/Zoom camera or all there is larger problem based on the target detection tracking system of fixed cameras, cannot meet the as far as possible few video camera of video monitoring system, realize wider covering, carry out the demand of more accurate intelligent video analysis effect, how fully to excavate the characteristic of Pan/Tilt/Zoom camera, the framework how carrying out intelligent video analysis system in conjunction with the characteristic of Pan/Tilt/Zoom camera becomes the key problem that we will solve.
Summary of the invention
In order to solve the problem, the invention provides a kind of intelligent video analysis system of cruising based on Pan/Tilt/Zoom camera, this system comprises front end Pan/Tilt/Zoom camera and back-end server, back-end server comprises: cruise configuration module, to cruise list for a little carrying out setting generation to the group and cruising of cruising of system, a presetting bit of a corresponding Pan/Tilt/Zoom camera that cruises of each group of cruising is cruising some configuration cruise mode and a cruise time of each group of cruising; Pan/Tilt/Zoom camera control module, to cruising, list is analyzed, and automatically generates execution list of cruising, and makes Pan/Tilt/Zoom camera between each presetting bit, carry out detection of cruising according to the order of cruising preset; Video analysis configuration module, the intelligent video analysis algorithm relevant for configuration of cruising for each is also configured to and cruises in list; System control module, perform the relevant video camera open function cruised a little, according to the algorithm configuration that each in configured list cruises a little, enable the relevant video analysis algorithm cruised a little, for each cruising a little is carried out camera parameters demarcation and call video-splicing module, automatically generate the panoramic mosaic figure in whole cycle of cruising according to the execution sequence cruised a little; Intelligent video analysis module, carries out target detection and event analysis according to relevant setting, and produces Real-time Alarm to the event detected; Alarm management module, carries out corresponding local management function to alarm.
It is exactly all or part of parameter being gone out projection matrix P by given reference substance backwards calculation that described camera parameters is demarcated, after demarcation, two-dimensional coordinate in the two dimensional image of being caught at camera by it, and the projection matrix P obtained, can ask the positional information of certain target in three-dimensional.
Described intelligent video analysis module comprises further: image pre-processing module, and adopt the self adaptation rapid image noise reduction algorithm of wavelet transformation to carry out filtering noise reduction to image, greyscale transformation operates; Module of target detection, for carrying out moving object detection, clarification of objective is extracted, pedestrian/vehicle detection, face/car plate detection and location, and carries out Target Recognition Algorithms according to clarification of objective; Target tracking module, utilizes two-way optical flow method to carry out target following; Target's feature-extraction module, the target detected previous frame sets up the joint histogram masterplate based on color and HOG feature, and this joint histogram combines the Gradient Features of color characteristic and HOG; Feature detection matching module, is carried out search coupling at present frame, is compared by Pasteur's distance, around the target location of previous frame, namely carries out searching for coupling within the scope of certain radius find best matched position to be the position of possible target at present frame; Event checking module, judges whether generation event based on the target location change detected.
Described module of target detection is, image conversion poor based on frame, the triplicity of mixed Gaussian probabilistic model detects target.
A kind of method that described pedestrian/vehicle detection adopts optical flow field relative motion and Hog+SVM model training to combine extracts the target of specified type.
Described video-splicing module is configured to further: the coupling of carrying out feature point extraction and characteristic point, be specially: represent the grey scale change situation of this pixel and vicinity points with minimal gray variance on four of pixel Main way, the i.e. interest value of pixel, then select the point with maximum interest value as characteristic point in the local of image, 4 regions are chosen in the lap of reference picture, each region utilizes Moravec operator to find out characteristic point, choose the region of the fixed size centered by characteristic point, the most similar coupling is found in search graph, utilize the central point of the characteristic area of coupling, substitute into following equation to solve, required solution is the conversion coefficient M between two width images:
Present invention also offers a kind of intelligent video analysis method of cruising based on Pan/Tilt/Zoom camera, it comprises:
Step (1) first carries out a little setting the group and cruising of cruising of system, generates list of cruising, a presetting bit of a corresponding Pan/Tilt/Zoom camera that cruises of each group of cruising, and is cruising some configuration cruise mode and a cruise time of each group of cruising;
Step (2) is called by presetting bit, Pan/Tilt/Zoom camera is moved to and cruises accordingly a little, system control module is that each cruising a little carries out camera parameters demarcation for current scene, and configures relevant intelligent video analysis algorithm by video analysis configuration module and add to and cruise in list;
After step (3) start up system, Pan/Tilt/Zoom camera control module, by the analysis to list of cruising, generates execution list of cruising automatically, makes Pan/Tilt/Zoom camera between each presetting bit, carry out detection of cruising according to the order of cruising preset;
Step (4) system control module calls video-splicing module, automatically generates the panoramic mosaic figure in whole cycle of cruising according to the execution sequence cruised a little;
Step (5) intelligent video analysis module carries out target detection and event analysis according to relevant setting, and produces real-time alarm to the event detected.
In described step (2), camera parameters is demarcated is exactly all or part of parameter being gone out projection matrix P by given reference substance backwards calculation, after demarcation, two-dimensional coordinate in the two dimensional image of being caught at camera by it, projection matrix P with obtaining, can ask the positional information of certain target in three-dimensional.
Described step (5) comprises further: adopt the self adaptation rapid image noise reduction algorithm of wavelet transformation to carry out filtering noise reduction to image, greyscale transformation operates; Carry out moving object detection, clarification of objective is extracted, pedestrian/vehicle detection, face/car plate detection and location, and carries out Target Recognition Algorithms according to clarification of objective; Two-way optical flow method is utilized to carry out target following; The target detected previous frame sets up the joint histogram masterplate based on color and HOG feature, and this joint histogram combines the Gradient Features of color characteristic and HOG; Carry out search coupling at present frame, compared by Pasteur's distance, around the target location of previous frame, namely within the scope of certain radius, carry out searching for coupling find best matched position to be the position of possible target at present frame; Generation event is judged whether based on the target location change detected.
Described target detection is, image conversion poor based on frame, the triplicity of mixed Gaussian probabilistic model detects target.
A kind of method that described pedestrian/vehicle detection adopts optical flow field relative motion and Hog+SVM model training to combine extracts the target of specified type.
Described video-splicing specifically comprises: represent the grey scale change situation of this pixel and vicinity points with minimal gray variance on four of pixel Main way, the i.e. interest value of pixel, then select the point with maximum interest value as characteristic point in the local of image, 4 regions are chosen in the lap of reference picture, each region utilizes Moravec operator to find out characteristic point, choose the region of the fixed size centered by characteristic point, the most similar coupling is found in search graph, utilize the central point of the characteristic area of coupling, substitute into following equation to solve, required solution is the conversion coefficient M between two width images:
Accompanying drawing explanation
Fig. 1 is the structured flowchart according to analytical system of the present invention;
Fig. 2 is the function diagram of the configuration module that cruises according to analytical system of the present invention;
Fig. 3 is the structure chart of the intelligent video analysis module according to analytical system of the present invention;
Fig. 4 is the module map that analytical system according to the present invention is carried out descriptive system control module and called;
Figure 5 shows that image coordinate system, the schematic diagram of camera coordinate system and world coordinate system.
Embodiment
For making above-mentioned purpose of the present invention, feature and advantage become apparent more, and below in conjunction with the drawings and specific embodiments, the present invention is further detailed explanation:
Present invention employs the front-end collection equipment of Pan/Tilt/Zoom camera as system, by cruising in conjunction with 360 degree of Pan/Tilt/Zoom camera and presetting bit fixed point cruise function exploitation video analysis algorithm, carry out target detection tracking, make a video camera can monitor larger field range, and by the Automatic Targets of video analysis algorithm and tracking, reach and can monitor multiple region with a video camera simultaneously and carry out Automatic Targets and identification requirement in a wider context.Both can save the lower deployment cost of system in actual applications, automatic target detection Tracking Recognition demand can be realized again, there is very large theory innovation and application innovation, and have great Social benefit and economic benefit.
The invention provides a kind of intelligent video analysis system of cruising based on Pan/Tilt/Zoom camera, primarily of front end Pan/Tilt/Zoom camera and back-end server composition, concrete configuration operation divides following steps:
Step 1: first carry out a little setting the group and cruising of cruising of system, generate by system list of cruising.A presetting bit of a corresponding Pan/Tilt/Zoom camera that cruises of each group of cruising.
Step 2: be cruising some configuration cruise mode and a cruise time of each group of cruising.
1. be a little configured to 360 degree of automatic cruise modes if cruised, need the direction that setting level (P) rotates, the cruise time, cruising speed class information.Set all presetting bits that will monitor successively, to be automatically generated to according to configuration information by system and to cruise in list.
2. be a little configured to cruise mode of fixing a point if cruised, then need to set the cruise time.Automatically to be generated to according to configuration information by Pan/Tilt/Zoom camera control module and to cruise in list.
Step 3: called by presetting bit, Pan/Tilt/Zoom camera is moved to and cruises accordingly a little, system control module is that each cruising a little carries out camera parameters demarcation for current scene, and configure relevant intelligent video analysis algorithm by video analysis configuration module: comprise behavioral value, vehicle detection, legacy detects, article remove detection, flame and Smoke Detection, traffic incidents detection, and cruise in list configuring to add to accordingly.
Step 4: after start up system, Pan/Tilt/Zoom camera control module, by the analysis to list of cruising, generates execution list of cruising automatically, makes Pan/Tilt/Zoom camera between each presetting bit, carry out detection of cruising according to the order of cruising preset.And system control module calls video-splicing module, automatically generate the panoramic mosaic figure in whole cycle of cruising according to the execution sequence cruised a little.What have overlapping region completes splicing automatically, splicing according to sequencing of zero lap region.
Step 5: intelligent video analysis module carries out target detection and event analysis according to relevant setting, and real-time alarm is produced to the event detected, alarm management module carries out the corresponding local management function of alarm, as video recording, grabgraf, bullet screen, and upload warning information by network and remind Surveillance center to carry out analyzing and processing to Surveillance center.
In described step 1, according to demand different time sections being monitored to different scene operation different intelligent video analysis algorithm, carry out cruise group and a configuration division of cruising, system generates list of cruising automatically.
In described step 2, to each cruise a little carry out 360 degree of automatic cruisings and fixed point cruise mode freely configure, Pan/Tilt/Zoom camera control module is automatically generated to and cruises in list.
In described step 2, cruise a fixed point cruise mode, then need control Pan/Tilt/Zoom camera in scene, carry out the setting of cruising a little, and to the order of cruising of cruising a little, time of staying information sets.Automatically to be generated to according to configuration information by Pan/Tilt/Zoom camera control module and to cruise in list.
In described step 3, demarcating the corresponding camera parameters cruised a little, is by determining the demarcation of diverse location people in scene.
In described step 3, the relevant intelligent video analysis algorithm for a configuration of cruising accordingly: comprise behavioral value, vehicle detection, legacy detects, and article remove detection, flame and Smoke Detection, traffic incidents detection.
In described step 4, after configuring all corresponding cruise parameter and intelligent video analysis algorithms cruised a little, start up system, makes system between each cruises a little, carry out detection of cruising according to the order of cruising preset.By the Pan/Tilt/Zoom camera control sequence in corresponding configured list rise time sequence, and corresponding intelligent video analysis algorithm calling sequence a little of cruising.
In described step 4, the cruise mode a little of cruising controls to be carried out according to a configuration of cruising by the Pan/Tilt/Zoom camera control module of server end, and especially 360 automatic cruisings are by horizontally rotating speed P with certain, rotates realization according to fixed direction.
In described step 4, system carries out the splicing of video image automatically according to the sequencing cruised a little, and the panoramic picture that realizing cruises organizes is shown.Particularly relate to have an overlapping region to 360 degree of panoramic mosaic rotated and picture automatically complete splicing, zero lap region carry out according to sequencing the strategy that splices.
In described step 5, this locality of carrying out alarm and corresponding video recording grabgraf stores and uploads to Surveillance center and reminds Surveillance center to carry out analyzing and processing.
The invention provides a kind of intelligent video analysis system of cruising based on Pan/Tilt/Zoom camera, by cruise group and the cruise management of a little carrying out system and call of the presetting bit of Pan/Tilt/Zoom camera according to setting, 360 degree can be carried out a little and cruise and cruise function of fixing a point cruising, the deployment of combined with intelligent video analysis algorithm, realize single camera Automatic Targets in larger scope and affair alarm, there is wider video monitoring and the ability of intelligent video analysis.Particularly for the video analysis under camera motion scene, by carrying out the detection of algorithm for pattern recognition to specific target, and by the demarcation of video camera and scene, determine the shape size of target, velocity information, makes the precision of target detection be greatly increased.360 degree of detections of cruising of Pan/Tilt/Zoom camera can also obtain panoramic picture, can indicate target and the position of event in scene more clearly, user friendly practical application.Can realize comprising behavioral value, vehicle detection by the cruise function of coupling system and intelligent video analysis algorithm, legacy detects, and article remove detection, flame and Smoke Detection, traffic incidents detection.
The invention reside in and a kind of intelligent video analysis system of cruising based on Pan/Tilt/Zoom camera is provided, the software and hardware architecture of system as shown in Figure 1, comprise front end Pan/Tilt/Zoom camera and back-end server, to cruise configuration module in back-end server deploy, Pan/Tilt/Zoom camera control module, video analysis configuration module, system control module, intelligent video analysis module, alarm management module, by carrying out cruising group and the configuration of cruising a little in conjunction with the cruise function of Pan/Tilt/Zoom camera and presetting bit function, and a little carry out the deployment of intelligent video analysis algorithm for each cruising, single camera is made to have wider video monitoring and intelligent video analysis ability, the framework of system has very large innovation, make system architecture simpler relative to multiple-camera monitoring, reduce deployment and the maintenance cost of system, there is very large economy and social value.
Below in conjunction with accompanying drawing, performing step of the present invention is described in further detail:
Step 1: in step 1, as shown in Figure 2, first we carry out the configuration of cruising of system, carry out dividing with cruising group according to the time period of system monitoring, under the scene needing monitoring, set presetting bit, and presetting bit is added to cruise in group accordingly, we claim presetting bit for cruising a little.As being group 1 of cruising at setting-up time section 8:00-12:00, setting-up time section 12:00-18:00 is group 2 of cruising, and we need Pan/Tilt/Zoom camera to be moved to A, B, C, D, E, F carry out the setting of presetting bit, we are with A, B, C, D, E, F represent corresponding presetting bit, by configuration of cruising successively A, B, C, D, presetting bit is cruised a little to add to as 4 and is cruised in group 1, D, E, F presetting bit is cruised a little to add to as 3 and is cruised in group 2, and system generates the Groups List that cruises automatically according to configuration.
Step 2: as shown in Figure 2, is followed successively by cruising of each group of cruising and a little carries out cruising the configuration of parameter, and configuration information is synchronized to cruises in list, and namely setting Pan/Tilt/Zoom camera is in corresponding parameter of cruising of cruising a little, comprises cruise mode, cruise time information.As the A that cruises for first group is set as
degree automatic cruise mode, left-handed rotation, the cruise time is 5 minutes, and cruising speed rank is 3; A B that cruises is fixed point cruise mode, and the cruise time is 5 minutes.
Step 3: as shown in Figure 2, by calling a little corresponding presetting bit of cruising, Pan/Tilt/Zoom camera is realized to move to the operation of cruising accordingly a little, carrying out corresponding camera parameters demarcation for a current scene of cruising, is an intelligent video analysis algorithm that configuration is relevant that cruises accordingly: comprise behavioral value, vehicle detection, legacy detects, article remove detection, flame and Smoke Detection, traffic incidents detection.Finally scene calibration, the configuration information of intelligent analysis process is corresponding with the configuration of cruising a little, is synchronized to and cruises in list.
Camera parameters scaling method:
Extract the crown and the sole point pair at pedestrian diverse location place in scene to be calibrated in one section of video, by these to the one group of vertical line section forming vertical scene ground, the end point of vertical direction and horizontal vanishing line can be calculated by this group vertical line section.If known the length of one group of orthogonal line segment on ground, can organize with this two other axis that orthogonal line segment is three-dimensional coordinate, calculate in these two axis two other end points on a horizontal.By three orthogonal end points, and the principal point coordinate of the video camera calculated, the inside and outside parameter of video camera can be calculated, then calculate the projection matrix of video camera, complete the demarcation of camera parameters.
Be illustrated in figure 5 image coordinate system, the spatial distribution of camera coordinate system and world coordinate system, wherein image coordinate system (o
0uv) with world coordinate system (O
1xY) be all two-dimensional coordinate system, and be same plane, difference be the origin of coordinates of image coordinate system in the most upper left corner, and the origin of coordinates of camera coordinate system is in the middle of image; World coordinate system is three-dimensional system of coordinate, 1 P(x in real space, y, z) by imaging, obtain some p (X, Y) in camera coordinate system.
Pin-hole imaging model is typical linear model, any point, space P(x, y, z) image in p (X, Y) point in camera coordinate system, can be obtained by similar triangles:
In formula, f is camera focal length.Joint image coordinate system is also expressed as by next coordinate form:
In formula, s is scale factor; α
x=f/dX is the scale factor on u axle; α
y=f/dY is the scale factor on v axle; u
0, v
0be respectively the position of camera coordinate system initial point in image coordinate system; R, t are respectively camera coordinates and lie in spin matrix between world coordinate system and translation vector;
Matrix M
1parameter alpha
x, α
y, u
0, v
0only relevant with intrinsic parameters of the camera, therefore these parameters are called intrinsic parameters of the camera; M
2parameter R, t is determined by the orientation of the relative world coordinate system of video camera, therefore video camera external parameter is called, the process that then camera parameters is demarcated then can be converted to and solve these parameters, and it is exactly all or part of parameter being gone out projection matrix P by given reference substance backwards calculation that camera parameters is demarcated.After having demarcated, if wonder the positional information of certain target in three-dimensional, the two-dimensional coordinate in the two dimensional image of being caught at camera by it, and the projection matrix P just now obtained, can be asked.
The flow process of intelligent video analysis algoritic module is as shown in Figure 3:
Image pre-processing module: the real-time video of collection is inevitably subject to light, rain, snow, the impact of mist and system interference, image can exist certain fuzzy, noise jamming problem.First will carry out filtering noise reduction to image, greyscale transformation operates.The present invention adopts the self adaptation rapid image noise reduction algorithm of wavelet transformation to carry out preliminary treatment to image.
Module of target detection: image is after noise reduction process, intelligent video analysis algorithm configuration according to presetting bit carries out invocation target detection module, carry out moving object detection, clarification of objective is extracted, pedestrian/vehicle detection, face/car plate detection and location, and carry out Target Recognition Algorithms according to clarification of objective.
Wherein module of target detection, for the static background of fixed point cruise mode, the present invention proposes a kind of background modeling method based on transform domain image, adopts based on having merged that frame is poor, image conversion (embossment conversion), mixed Gaussian probabilistic model detect target.Wherein frame is poor, embossment converts, and Gaussian modeling all has certain light adaptation to a certain extent, carries out background modeling process in conjunction with three, further enhancing the adaptability of algorithm to complex situations such as light, the more complete moving target extracting scene.
1. frame difference can be the difference of consecutive frame or the difference of a little interframe.The method has stronger scene changes adaptive capacity, anti-illumination variation and noise resisting ability strong;
F(x,y)=abs(I
n(x，y)I
(n-i)(x，y))
Wherein, I
nthe gray value that (x, y) puts for n moment (x, y), I
(n-i)(x, y) represents the gray value at the n-th-i two field picture coordinate (x, y) place, and i gets 3 ~ 5 usually.Image, through the process of embossment mapping algorithm, also has certain anti-light photograph changing capability; Embossment algorithm carries out process of convolution to each point of image to adopt following matrix to carry out:
For coordinate (i, i) point, the algorithm of its anaglyph figure is:
Y(i，j)=X(i-1，j-1)-X(i-1，j+1)+128
Wherein, X (i, j) and Y (i, j) is respectively the original pixel value of (i, j) coordinate points and the pixel value after converting.
2. utilize frame difference image, embossment changing image, original-gray image combines as the input source image of mixed Gaussian background modeling, sets up probabilistic model, carries out the detection of foreground target.The theoretical foundation of the method is sturdy, and can add priori, Detection results is good.
The basic thought of mixed Gaussian background modeling is that the color that each pixel presents is represented by K state, and usual K gets between 3-5.The pixel value obtaining video image at each moment T is the sampled value of stochastic variable X.Gauss model has three parameters, is respectively average μ
kvariances sigma
k, weights omega
k, l≤k≤K.。
K the weights being distributed in moment t can upgrade with following formula:
The more new formula of weights:
Model modification formula is:
Wherein, α is turnover rate, 0 < α <, 1l k lK, when the model of the 1st Satisfying Matching Conditions is k, and M
k(x, y)-_ 1, otherwise M
k(x, y)=0.
When the model number of a pixel is k, and during k>1, to this k model according to priority size sort, priority computing formula is
when mating, mate from the model that priority is maximum, if the model of first Satisfying Matching Conditions is k, then namely k puts the Matching Model in this moment for this, does not need the Model Matching little with priority ratio k again.
Through context update and the study of limited frame, set up a background model.
Highest priority is nursed: the present invention mainly develops according to the fixed target patrolled on waypoint location, edge between double detection and graded determine the degree changed between twice detection, produce alarm when the intensity of variation between twice detection is greater than the threshold value of setting.
The present invention adopts Canny convolution operator to carry out computing to image, adopts local maximum policy filtering to fall most of non-edge point.
Its x to, y to first-order partial derivative matrix, the mathematic(al) representation of gradient magnitude and gradient direction is:
P [ij]=(f [i, j+1]-f [i, j]+f [i+1, j 10]-f [i, j])/2
Q[i，j]＝(f[i，j]-f[i+1，j]+f[i，j+1]-f[i+1，j+1])/2
θ[i，j]＝arctan(Q[i，j]/P[i，j])
The gradient magnitude of M [i, j] presentation video at coordinate [i, j] place in above formula, θ [i, j] represents the gradient direction at coordinate [i, j] place.
Pedestrian/vehicle detection: for 360 degree of cruise modes, the present invention proposes the target that a kind of method that optical flow field relative motion and Hog+SVM model training combine extracts specified type, in the detection of pedestrian and vehicle, achieve good Detection results, and be widely used in unattended project.HOG is exactly the one abbreviation of finger direction histogram of gradients (Histogram of Oriented Gradient, HOG), is a kind of profiler being used for carrying out object detection in computer vision and image procossing.It carrys out constitutive characteristic by the gradient orientation histogram of calculating and statistical picture regional area; Its main thought is in a sub-picture, and the presentation of localized target and shape can be described well by the direction density distribution at gradient or edge.Its concrete implementation method is: first image is divided into little connected region, we are cell factory it.Then gather the gradient of each pixel in cell factory or edge direction histogram.Finally altogether just can constitutive characteristic describer these set of histograms.
SVM is the abbreviation of SVMs (Support Vector Machine), that Corinna Cortes and Vapnik8 equals nineteen ninety-five and first propose, it shows many distinctive advantages in solution small sample, non-linear and high dimensional pattern identification, and can promote the use of in the other machines problems concerning study such as Function Fitting.Support vector machine method is that the VC being based upon Statistical Learning Theory ties up on theoretical and Structural risk minization basis, between the complexity (namely to the study precision of specific training sample) and learning ability (namely identifying the ability of arbitrary sample error-free) of model, optimal compromise is sought, in the hope of obtaining best Generalization Ability according to limited sample information.
Carry out Hog+SVM training and detect dividing following step:
1). collect training sample, comprise a large amount of positive samples and negative sample.Manual cutting sample, unification zooms to fixed size.
2). extract the feature of all positive samples and negative sample respectively.
3). give sample label to all positive negative samples, positive sample labeling is 1, and negative sample is labeled as-1.
4). by the Hog feature of positive negative sample, positive and negative sample label, is input in Linear SVM grader and trains.
5). utilize the grader trained to detect the target in scene.
Two-way optical flow method: optical flow method concept is derived from optical flow field, the video pattern further from the teeth outwards of moving object is exactly so-called optical flow field, is a two-dimension speed field.If I is (x, y, t) be the pixel value of picture point (x, y) at moment t, if u is (x, y) with v (x, y) be x and the y component of this light stream, postulated point pixel value when t+ δ t moves to (x+ δ xly+ δ y) remains unchanged, δ x=u δ t, δ y=v δ t, then have optical flow equation:
I(x+uδt，y+uδt，t+δt)＝Ｉ（x，y，t)
The corresponding relation that the correlation between change and consecutive frame utilizing pixel in image sequence in time-domain exists between present frame to find previous frame to follow, thus a kind of method optical flow method calculating the movable information of object between consecutive frame actual be by the intensity of detected image pixel over time and then infer the method in object translational speed and direction.
The candidate target of Hog+SVM detection of classifier is carried out to the calculating in bi-directional light flow field, the people and Che etc. that have relative motion can be detected in scene more accurately.Improve accuracy of detection and reduce flase drop.
Target tracking module: target following is exactly analyze the interesting target detected in time domain, obtain target state parameter as change in location movement locus time/spatial feature, to carry out next step Treatment Analysis, as behavioural analysis etc.The two-way optical flow method that the present invention mentions above using carries out target following, effectively can utilize the information in the Time domain and Space territory of moving target, thus make to follow the tracks of accurate stable more, to some extent solve the collision separation between the internal object of visual field and occlusion issue.
Comparatively speaking, the general unobstructed problem of the method based on model, but be difficult to set up a general template (as deforming template).How to define in addition coupling measure make tracking be more accurately again a great problem.
Target's feature-extraction module: the target detected previous frame sets up the joint histogram masterplate based on color and HOG feature, and this joint histogram combines the Gradient Features of color characteristic and HOG, can be good at than more completely describing target signature information.
Feature detection matching module: carry out search coupling at present frame, compared by Pasteur's distance (a kind of method of measuring histogram difference), namely around the target location of previous frame, within the scope of certain radius, carry out search coupling (finding that radius is that 20 pixel effects are relatively good in our practice), find best matched position to be the position of possible target at present frame.
Event checking module: for judging whether generation event according to the target location change detected.
Step 4: as shown in Figure 4, after configuring all cruise parameter and the intelligent video analysis algorithm that cruise a little, start up system, by the analysis controlling list of cruising, automatic generation is cruised execution list, makes Pan/Tilt/Zoom camera between each cruises a little, carry out detection of cruising according to the order of cruising preset.And system call video-splicing module, generates the panoramic mosaic figure in whole cycle of cruising automatically according to the execution sequence cruised a little.What have overlapping region completes splicing automatically, splicing according to sequencing of zero lap region.
Video automatic Mosaic algorithm: the image mosaic technology of distinguished point based, as the core technology of video-splicing technology, is mainly divided into coupling two step of feature point extraction and characteristic point.
The present invention adopts Moravec operator to carry out feature point extraction, its basic thought is, the grey scale change situation of this pixel and vicinity points is represented with minimal gray variance on four of pixel Main way, the i.e. interest value of pixel, then selects the point (the obvious point of grey scale change) with maximum interest value as characteristic point in the local of image.
Wherein
g
c+i, rpresentation video is at the gray value at coordinate [c+i, r] place, and by that analogy, getting wherein reckling is the interest value of pixel IV (c, r):
IV(c，r)＝V＝min{V
1，V
2，V
3，V
4}
According to given threshold value, interest value is selected to be greater than the candidate point of point as characteristic point of this threshold value.If V
tfor the threshold value set in advance, if V > is V
t, then V is the candidate point of characteristic point.Local modulus maxima is chosen as the characteristic point needed in candidate point.
On the basis of the feature point extraction more than having had, feature based point matching algorithm key step is as follows:
(1) in the lap of reference picture T, choose 4 regions, each region utilizes Moravec operator to find out characteristic point.
(2) choose the region centered by characteristic point, the present invention of this region select size be 7 × 7 region, in search graph S, find the most similar coupling.Because there are 4 characteristic points, therefore there are 4 characteristic areas, find the coupling of corresponding characteristic area also to have 4 pieces.
(3) utilize the central point of these the 4 groups characteristic areas mated, namely 4 to the characteristic point of mating, and substitute into following equation and solve, required solution is the conversion coefficient between two width images.
Step 5:
System control module performs the relevant video camera open function cruised a little, then according to the algorithm configuration that each in algorithm configuration list cruises a little, enables the relevant video analysis algorithm cruised a little, namely deploy troops on garrison duty to the algorithm that each cruises a little.
Video analysis algorithm carries out target detection and event detection according to relevant setting, and produces real-time alarm to the time detected, carries out alarm and corresponding video recording, and grabgraf carries out this locality storage and upload to Surveillance center reminding Surveillance center to carry out analyzing and processing.Control platform receives video analysis result, issues various management and control order according to analysis result.
Be more than the detailed description of carrying out the preferred embodiments of the present invention, but those of ordinary skill in the art it should be appreciated that within the scope of the present invention, and guided by the spirit, various improvement, interpolation and replacement are all possible.These are all in the protection range that claim of the present invention limits.
Claims (12)
1. based on the intelligent video analysis system that Pan/Tilt/Zoom camera cruises, this system comprises front end Pan/Tilt/Zoom camera and back-end server, it is characterized in that back-end server comprises:
Cruise configuration module, and cruising a presetting bit of list, a corresponding Pan/Tilt/Zoom camera that cruises of each group of cruising for a little carrying out setting generation to the group and cruising of cruising of system, is cruising some configuration cruise mode and a cruise time of each group of cruising;
Pan/Tilt/Zoom camera control module, to cruising, list is analyzed, and automatically generates execution list of cruising, and makes Pan/Tilt/Zoom camera between each presetting bit, carry out detection of cruising according to the order of cruising preset;
Video analysis configuration module, the intelligent video analysis algorithm relevant for configuration of cruising for each is also configured to and cruises in list;
System control module, perform the relevant video camera open function cruised a little, according to the algorithm configuration that each in configured list cruises a little, enable the relevant video analysis algorithm cruised a little, for each cruising a little is carried out camera parameters demarcation and call video-splicing module, automatically generate the panoramic mosaic figure in whole cycle of cruising according to the execution sequence cruised a little;
Intelligent video analysis module, carries out target detection and event analysis according to relevant setting, and produces Real-time Alarm to the event detected;
Alarm management module, carries out corresponding local management function to alarm.
2. system according to claim 1, is characterized in that:
It is exactly all or part of parameter being gone out projection matrix P by given reference substance backwards calculation that described camera parameters is demarcated, after demarcation, two-dimensional coordinate in the two dimensional image of being caught at camera by it, and the projection matrix P obtained, can ask the positional information of certain target in three-dimensional.
3. system according to claim 1, is characterized in that described intelligent video analysis module comprises further:
Image pre-processing module, adopt the self adaptation rapid image noise reduction algorithm of wavelet transformation to carry out filtering noise reduction to image, greyscale transformation operates;
Module of target detection, for carrying out moving object detection, clarification of objective is extracted, pedestrian/vehicle detection, face/car plate detection and location, and carries out Target Recognition Algorithms according to clarification of objective;
Target tracking module, utilizes two-way optical flow method to carry out target following;
Target's feature-extraction module, the target detected previous frame sets up the joint histogram masterplate based on color and HOG feature, and this joint histogram combines the Gradient Features of color characteristic and HOG;
Feature detection matching module, is carried out search coupling at present frame, is compared by Pasteur's distance, around the target location of previous frame, namely carries out searching for coupling within the scope of certain radius find best matched position to be the position of possible target at present frame;
Event checking module, judges whether generation event based on the target location change detected.
4. system according to claim 3, is characterized in that described module of target detection is, image conversion poor based on frame, the triplicity of mixed Gaussian probabilistic model detects target.
5. system according to claim 3, is characterized in that: a kind of method that described pedestrian/vehicle detection adopts optical flow field relative motion and Hog+SVM model training to combine extracts the target of specified type.
6. system according to claim 1, it is characterized in that: described video-splicing module is configured to further: the coupling of carrying out feature point extraction and characteristic point, be specially: represent the grey scale change situation of this pixel and vicinity points with minimal gray variance on four of pixel Main way, the i.e. interest value of pixel, then select the point with maximum interest value as characteristic point in the local of image, 4 regions are chosen in the lap of reference picture, each region utilizes Moravec operator to find out characteristic point, choose the region of the fixed size centered by characteristic point, the most similar coupling is found in search graph, utilize the central point of the characteristic area of coupling, substitute into following equation to solve, required solution is the conversion coefficient M between two width images:
7., based on the intelligent video analysis method that Pan/Tilt/Zoom camera cruises, it is characterized in that:
Step (1) first carries out a little setting the group and cruising of cruising of system, generates list of cruising, a presetting bit of a corresponding Pan/Tilt/Zoom camera that cruises of each group of cruising, and is cruising some configuration cruise mode and a cruise time of each group of cruising;
Step (2) is called by presetting bit, Pan/Tilt/Zoom camera is moved to and cruises accordingly a little, system control module is that each cruising a little carries out camera parameters demarcation for current scene, and configures relevant intelligent video analysis algorithm by video analysis configuration module and add to and cruise in list;
After step (3) start up system, Pan/Tilt/Zoom camera control module, by the analysis to list of cruising, generates execution list of cruising automatically, makes Pan/Tilt/Zoom camera between each presetting bit, carry out detection of cruising according to the order of cruising preset;
Step (4) system control module calls video-splicing module, automatically generates the panoramic mosaic figure in whole cycle of cruising according to the execution sequence cruised a little;
Step (5) intelligent video analysis module carries out target detection and event analysis according to relevant setting, and produces real-time alarm to the event detected.
8. method according to claim 7, is characterized in that:
In described step (2), camera parameters is demarcated is exactly all or part of parameter being gone out projection matrix P by given reference substance backwards calculation, after demarcation, two-dimensional coordinate in the two dimensional image of being caught at camera by it, projection matrix P with obtaining, can ask the positional information of certain target in three-dimensional.
9. method according to claim 7, is characterized in that described step (5) comprises further:
Adopt the self adaptation rapid image noise reduction algorithm of wavelet transformation to carry out filtering noise reduction to image, greyscale transformation operates;
Carry out moving object detection, clarification of objective is extracted, pedestrian/vehicle detection, face/car plate detection and location, and carries out Target Recognition Algorithms according to clarification of objective;
Two-way optical flow method is utilized to carry out target following;
The target detected previous frame sets up the joint histogram masterplate based on color and HOG feature, and this joint histogram combines the Gradient Features of color characteristic and HOG;
Carry out search coupling at present frame, compared by Pasteur's distance, around the target location of previous frame, namely within the scope of certain radius, carry out searching for coupling find best matched position to be the position of possible target at present frame;
Generation event is judged whether based on the target location change detected.
10. method according to claim 9, is characterized in that described target detection is, image conversion poor based on frame, the triplicity of mixed Gaussian probabilistic model detects target.
11. methods according to claim 9, is characterized in that: a kind of method that described pedestrian/vehicle detection adopts optical flow field relative motion and Hog+SVM model training to combine extracts the target of specified type.
12. methods according to claim 7, it is characterized in that: described video-splicing specifically comprises: represent the grey scale change situation of this pixel and vicinity points with minimal gray variance on four of pixel Main way, the i.e. interest value of pixel, then select the point with maximum interest value as characteristic point in the local of image, 4 regions are chosen in the lap of reference picture, each region utilizes Moravec operator to find out characteristic point, choose the region of the fixed size centered by characteristic point, the most similar coupling is found in search graph, utilize the central point of the characteristic area of coupling, substitute into following equation to solve, required solution is the conversion coefficient M between two width images:
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310359688.8A CN104378582B (en) | 2013-08-16 | 2013-08-16 | A kind of intelligent video analysis system and method cruised based on Pan/Tilt/Zoom camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310359688.8A CN104378582B (en) | 2013-08-16 | 2013-08-16 | A kind of intelligent video analysis system and method cruised based on Pan/Tilt/Zoom camera |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104378582A true CN104378582A (en) | 2015-02-25 |
| CN104378582B CN104378582B (en) | 2017-08-22 |
Family
ID=52557203
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310359688.8A Expired - Fee Related CN104378582B (en) | 2013-08-16 | 2013-08-16 | A kind of intelligent video analysis system and method cruised based on Pan/Tilt/Zoom camera |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104378582B (en) |
Cited By (33)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104754231A (en) * | 2015-03-31 | 2015-07-01 | 广东欧珀移动通信有限公司 | People video shooting method and device |
| CN105282521A (en) * | 2015-11-21 | 2016-01-27 | 浙江宇视科技有限公司 | Method and device for detecting motion during IP camera cruising process |
| CN105700547A (en) * | 2016-01-16 | 2016-06-22 | 深圳先进技术研究院 | Aerial stereoscopic video streetscape system based on a navigation airship and an implement method |
| CN105915800A (en) * | 2016-06-03 | 2016-08-31 | 中林信达（北京）科技信息有限责任公司 | Automatic configuration method of complete covering cruise parameter under large scene monitoring and apparatus thereof |
| CN105933678A (en) * | 2016-07-01 | 2016-09-07 | 湖南源信光电科技有限公司 | Multi-focal length lens linkage imaging device based on multi-target intelligent tracking |
| CN106162070A (en) * | 2015-04-23 | 2016-11-23 | 神讯电脑(昆山)有限公司 | Safety monitoring system and method thereof |
| CN107197278A (en) * | 2017-05-24 | 2017-09-22 | 西安万像电子科技有限公司 | The treating method and apparatus of the global motion vector of screen picture |
| CN107360394A (en) * | 2017-06-16 | 2017-11-17 | 河北汉光重工有限责任公司 | More preset point dynamic and intelligent monitoring methods applied to frontier defense video monitoring system |
| CN107590834A (en) * | 2017-08-10 | 2018-01-16 | 北京博思廷科技有限公司 | A kind of road traffic accident video detecting method and system |
| CN107680103A (en) * | 2017-09-12 | 2018-02-09 | 南方医科大学南方医院 | The method that actual situation for stomach cancer hysteroscope intelligent operation real-time navigation system blocks processing mixed reality automatically |
| CN108230348A (en) * | 2016-12-22 | 2018-06-29 | 杭州海康威视数字技术股份有限公司 | A kind of method for tracking target and device |
| CN108234927A (en) * | 2016-12-20 | 2018-06-29 | 腾讯科技（深圳）有限公司 | Video frequency tracking method and system |
| CN108337486A (en) * | 2018-04-19 | 2018-07-27 | 北京软通智城科技有限公司 | A kind of device and method of the video analysis of the algorithm configuration based on scene |
| CN109194927A (en) * | 2018-10-19 | 2019-01-11 | 天津天地基业科技有限公司 | Vehicle-mounted target tracking holder camera apparatus based on deep learning |
| CN109982047A (en) * | 2019-04-04 | 2019-07-05 | 郑州和光电子科技有限公司 | A method of flight monitoring panorama fusion display |
| CN110113560A (en) * | 2018-02-01 | 2019-08-09 | 中兴飞流信息科技有限公司 | The method and server of video intelligent linkage |
| CN111192426A (en) * | 2020-01-14 | 2020-05-22 | 中兴飞流信息科技有限公司 | Railway perimeter intrusion detection method based on anthropomorphic visual image analysis video cruising |
| CN111246097A (en) * | 2020-01-19 | 2020-06-05 | 成都依能科技股份有限公司 | PTZ scanning path generation method based on graph perception |
| CN111259825A (en) * | 2020-01-19 | 2020-06-09 | 成都依能科技股份有限公司 | PTZ scanning path generation method based on face recognition |
| CN111343377A (en) * | 2018-12-19 | 2020-06-26 | 杭州海康威视系统技术有限公司 | Camera control method, device, system and storage medium |
| CN111382697A (en) * | 2020-03-09 | 2020-07-07 | 中国铁塔股份有限公司 | Image data processing method and first electronic equipment |
| CN111683229A (en) * | 2020-06-22 | 2020-09-18 | 杭州海康威视系统技术有限公司 | Cruise monitoring method, device, equipment and storage medium |
| CN112367475A (en) * | 2021-01-15 | 2021-02-12 | 上海闪马智能科技有限公司 | Traffic incident detection method and system and electronic equipment |
| CN112378385A (en) * | 2020-07-31 | 2021-02-19 | 浙江宇视科技有限公司 | Method, device, medium and electronic equipment for determining position of attention information |
| CN112672064A (en) * | 2021-03-18 | 2021-04-16 | 视云融聚（广州）科技有限公司 | Algorithm scheduling method, system and equipment based on video region label |
| CN112885096A (en) * | 2021-02-05 | 2021-06-01 | 同济大学 | Bridge floor traffic flow full-view-field sensing system and method depending on bridge arch ribs |
| CN113542672A (en) * | 2021-05-25 | 2021-10-22 | 浙江大华技术股份有限公司 | Camera cruising method, electronic device and storage medium |
| CN113643449A (en) * | 2021-08-11 | 2021-11-12 | 周健龙 | Vehicle following prevention device for entrance/exit of barrier-free parking lot and processing method |
| CN113920194A (en) * | 2021-10-08 | 2022-01-11 | 电子科技大学 | Four-rotor aircraft positioning method based on visual inertia fusion |
| CN115086559A (en) * | 2022-06-14 | 2022-09-20 | 北京宜通科创科技发展有限责任公司 | Intelligent cruise method, system and equipment |
| CN115243010A (en) * | 2022-07-15 | 2022-10-25 | 浪潮通信信息系统有限公司 | Bright kitchen scene intelligent detection system and device |
| CN116700247A (en) * | 2023-05-30 | 2023-09-05 | 东莞市华复实业有限公司 | Intelligent cruising management method and system for household robot |
| CN116958707A (en) * | 2023-08-18 | 2023-10-27 | 武汉市万睿数字运营有限公司 | Image classification method, device and related medium based on spherical machine monitoring equipment |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050275723A1 (en) * | 2004-06-02 | 2005-12-15 | Sezai Sablak | Virtual mask for use in autotracking video camera images |
| CN101119482A (en) * | 2007-09-28 | 2008-02-06 | 北京智安邦科技有限公司 | Overall view monitoring method and apparatus |
| CN101616310A (en) * | 2009-07-17 | 2009-12-30 | 清华大学 | The target image stabilizing method of binocular vision system of variable visual angle and resolution |
| CN101719968A (en) * | 2009-12-18 | 2010-06-02 | 中兴通讯股份有限公司 | Schedule management method, terminal and system |
| CN102866712A (en) * | 2012-09-07 | 2013-01-09 | 安科智慧城市技术（中国）有限公司 | Method and system for realizing automatic cruise of pan-tilts |
| US20130021433A1 (en) * | 2011-07-21 | 2013-01-24 | Robert Bosch Gmbh | Overview configuration and control method for ptz cameras |
| CN202907049U (en) * | 2012-11-06 | 2013-04-24 | 温州金谷丰垣工贸有限公司 | Automatic cruising camera |
-
2013
- 2013-08-16 CN CN201310359688.8A patent/CN104378582B/en not_active Expired - Fee Related
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050275723A1 (en) * | 2004-06-02 | 2005-12-15 | Sezai Sablak | Virtual mask for use in autotracking video camera images |
| CN101119482A (en) * | 2007-09-28 | 2008-02-06 | 北京智安邦科技有限公司 | Overall view monitoring method and apparatus |
| CN101616310A (en) * | 2009-07-17 | 2009-12-30 | 清华大学 | The target image stabilizing method of binocular vision system of variable visual angle and resolution |
| CN101719968A (en) * | 2009-12-18 | 2010-06-02 | 中兴通讯股份有限公司 | Schedule management method, terminal and system |
| US20130021433A1 (en) * | 2011-07-21 | 2013-01-24 | Robert Bosch Gmbh | Overview configuration and control method for ptz cameras |
| CN102866712A (en) * | 2012-09-07 | 2013-01-09 | 安科智慧城市技术（中国）有限公司 | Method and system for realizing automatic cruise of pan-tilts |
| CN202907049U (en) * | 2012-11-06 | 2013-04-24 | 温州金谷丰垣工贸有限公司 | Automatic cruising camera |
Non-Patent Citations (3)
| Title |
|---|
| 冯宇平: "图像快速配准与自动拼接技术研究", 《中国博士学位论文全文数据库 信息科技辑》 * |
| 曾鹏鑫: "动态场景下多运动目标检测及跟踪方法研究", 《中国优秀博硕士学位论文全文数据库 信息科技辑》 * |
| 赵雁斌: "高清视频会议智能终端的研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (53)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104754231A (en) * | 2015-03-31 | 2015-07-01 | 广东欧珀移动通信有限公司 | People video shooting method and device |
| CN104754231B (en) * | 2015-03-31 | 2019-02-19 | Oppo广东移动通信有限公司 | Shoot the method and device of personage's video |
| CN106162070B (en) * | 2015-04-23 | 2019-07-30 | 神讯电脑(昆山)有限公司 | Safety monitoring system and its method |
| CN106162070A (en) * | 2015-04-23 | 2016-11-23 | 神讯电脑(昆山)有限公司 | Safety monitoring system and method thereof |
| CN105282521A (en) * | 2015-11-21 | 2016-01-27 | 浙江宇视科技有限公司 | Method and device for detecting motion during IP camera cruising process |
| CN105282521B (en) * | 2015-11-21 | 2018-09-14 | 浙江宇视科技有限公司 | Method for testing motion and device in a kind of cruise of web camera |
| CN105700547A (en) * | 2016-01-16 | 2016-06-22 | 深圳先进技术研究院 | Aerial stereoscopic video streetscape system based on a navigation airship and an implement method |
| CN105700547B (en) * | 2016-01-16 | 2018-07-27 | 深圳先进技术研究院 | A kind of aerial three-dimensional video-frequency streetscape system and implementation method based on navigation dirigible |
| CN105915800A (en) * | 2016-06-03 | 2016-08-31 | 中林信达（北京）科技信息有限责任公司 | Automatic configuration method of complete covering cruise parameter under large scene monitoring and apparatus thereof |
| CN105915800B (en) * | 2016-06-03 | 2019-04-02 | 中林信达（北京）科技信息有限责任公司 | Large scene monitors the method for automatic configuration and device of lower all standing cruise parameter |
| CN105933678A (en) * | 2016-07-01 | 2016-09-07 | 湖南源信光电科技有限公司 | Multi-focal length lens linkage imaging device based on multi-target intelligent tracking |
| CN108234927A (en) * | 2016-12-20 | 2018-06-29 | 腾讯科技（深圳）有限公司 | Video frequency tracking method and system |
| CN108230348A (en) * | 2016-12-22 | 2018-06-29 | 杭州海康威视数字技术股份有限公司 | A kind of method for tracking target and device |
| CN108230348B (en) * | 2016-12-22 | 2022-01-21 | 杭州海康威视数字技术股份有限公司 | Target tracking method and device |
| CN107197278B (en) * | 2017-05-24 | 2019-08-23 | 西安万像电子科技有限公司 | The treating method and apparatus of the global motion vector of screen picture |
| CN107197278A (en) * | 2017-05-24 | 2017-09-22 | 西安万像电子科技有限公司 | The treating method and apparatus of the global motion vector of screen picture |
| CN107360394B (en) * | 2017-06-16 | 2019-09-27 | 河北汉光重工有限责任公司 | More preset point dynamic and intelligent monitoring methods applied to frontier defense video monitoring system |
| CN107360394A (en) * | 2017-06-16 | 2017-11-17 | 河北汉光重工有限责任公司 | More preset point dynamic and intelligent monitoring methods applied to frontier defense video monitoring system |
| CN107590834A (en) * | 2017-08-10 | 2018-01-16 | 北京博思廷科技有限公司 | A kind of road traffic accident video detecting method and system |
| CN107680103A (en) * | 2017-09-12 | 2018-02-09 | 南方医科大学南方医院 | The method that actual situation for stomach cancer hysteroscope intelligent operation real-time navigation system blocks processing mixed reality automatically |
| CN110113560A (en) * | 2018-02-01 | 2019-08-09 | 中兴飞流信息科技有限公司 | The method and server of video intelligent linkage |
| CN110113560B (en) * | 2018-02-01 | 2021-06-04 | 中兴飞流信息科技有限公司 | Intelligent video linkage method and server |
| CN108337486A (en) * | 2018-04-19 | 2018-07-27 | 北京软通智城科技有限公司 | A kind of device and method of the video analysis of the algorithm configuration based on scene |
| CN109194927A (en) * | 2018-10-19 | 2019-01-11 | 天津天地基业科技有限公司 | Vehicle-mounted target tracking holder camera apparatus based on deep learning |
| CN111343377A (en) * | 2018-12-19 | 2020-06-26 | 杭州海康威视系统技术有限公司 | Camera control method, device, system and storage medium |
| CN109982047A (en) * | 2019-04-04 | 2019-07-05 | 郑州和光电子科技有限公司 | A method of flight monitoring panorama fusion display |
| CN109982047B (en) * | 2019-04-04 | 2021-02-02 | 郑州和光电子科技有限公司 | Flight monitoring panorama fusion display method |
| CN111192426A (en) * | 2020-01-14 | 2020-05-22 | 中兴飞流信息科技有限公司 | Railway perimeter intrusion detection method based on anthropomorphic visual image analysis video cruising |
| CN111259825A (en) * | 2020-01-19 | 2020-06-09 | 成都依能科技股份有限公司 | PTZ scanning path generation method based on face recognition |
| CN111246097A (en) * | 2020-01-19 | 2020-06-05 | 成都依能科技股份有限公司 | PTZ scanning path generation method based on graph perception |
| CN111259825B (en) * | 2020-01-19 | 2023-06-02 | 成都依能科技股份有限公司 | PTZ scanning path generation method based on face recognition |
| CN111382697A (en) * | 2020-03-09 | 2020-07-07 | 中国铁塔股份有限公司 | Image data processing method and first electronic equipment |
| CN111382697B (en) * | 2020-03-09 | 2023-07-25 | 中国铁塔股份有限公司 | Image data processing method and first electronic equipment |
| CN111683229A (en) * | 2020-06-22 | 2020-09-18 | 杭州海康威视系统技术有限公司 | Cruise monitoring method, device, equipment and storage medium |
| CN111683229B (en) * | 2020-06-22 | 2021-10-26 | 杭州海康威视系统技术有限公司 | Cruise monitoring method, device, equipment and storage medium |
| CN112378385A (en) * | 2020-07-31 | 2021-02-19 | 浙江宇视科技有限公司 | Method, device, medium and electronic equipment for determining position of attention information |
| CN112367475A (en) * | 2021-01-15 | 2021-02-12 | 上海闪马智能科技有限公司 | Traffic incident detection method and system and electronic equipment |
| CN112367475B (en) * | 2021-01-15 | 2021-03-30 | 上海闪马智能科技有限公司 | Traffic incident detection method and system and electronic equipment |
| CN112885096A (en) * | 2021-02-05 | 2021-06-01 | 同济大学 | Bridge floor traffic flow full-view-field sensing system and method depending on bridge arch ribs |
| CN112672064A (en) * | 2021-03-18 | 2021-04-16 | 视云融聚（广州）科技有限公司 | Algorithm scheduling method, system and equipment based on video region label |
| CN113542672B (en) * | 2021-05-25 | 2023-08-18 | 浙江大华技术股份有限公司 | Camera cruising method, electronic device and storage medium |
| CN113542672A (en) * | 2021-05-25 | 2021-10-22 | 浙江大华技术股份有限公司 | Camera cruising method, electronic device and storage medium |
| CN113643449B (en) * | 2021-08-11 | 2023-07-18 | 周健龙 | Anti-following device for gateway-free parking lot entrance and exit and processing method |
| CN113643449A (en) * | 2021-08-11 | 2021-11-12 | 周健龙 | Vehicle following prevention device for entrance/exit of barrier-free parking lot and processing method |
| CN113920194B (en) * | 2021-10-08 | 2023-04-21 | 电子科技大学 | Positioning method of four-rotor aircraft based on visual inertia fusion |
| CN113920194A (en) * | 2021-10-08 | 2022-01-11 | 电子科技大学 | Four-rotor aircraft positioning method based on visual inertia fusion |
| CN115086559A (en) * | 2022-06-14 | 2022-09-20 | 北京宜通科创科技发展有限责任公司 | Intelligent cruise method, system and equipment |
| CN115086559B (en) * | 2022-06-14 | 2024-04-05 | 北京宜通科创科技发展有限责任公司 | Intelligent cruising method, system and equipment |
| CN115243010A (en) * | 2022-07-15 | 2022-10-25 | 浪潮通信信息系统有限公司 | Bright kitchen scene intelligent detection system and device |
| CN116700247A (en) * | 2023-05-30 | 2023-09-05 | 东莞市华复实业有限公司 | Intelligent cruising management method and system for household robot |
| CN116700247B (en) * | 2023-05-30 | 2024-03-19 | 东莞市华复实业有限公司 | Intelligent cruising management method and system for household robot |
| CN116958707A (en) * | 2023-08-18 | 2023-10-27 | 武汉市万睿数字运营有限公司 | Image classification method, device and related medium based on spherical machine monitoring equipment |
| CN116958707B (en) * | 2023-08-18 | 2024-04-23 | 武汉市万睿数字运营有限公司 | Image classification method, device and related medium based on spherical machine monitoring equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104378582B (en) | 2017-08-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104378582A (en) | Intelligent video analysis system and method based on PTZ video camera cruising | |
| CN113506317B (en) | Multi-target tracking method based on Mask R-CNN and apparent feature fusion | |
| Xie et al. | Video crowd detection and abnormal behavior model detection based on machine learning method | |
| Gurghian et al. | Deeplanes: End-to-end lane position estimation using deep neural networksa | |
| Nieto et al. | Road environment modeling using robust perspective analysis and recursive Bayesian segmentation | |
| CN103824070B (en) | A kind of rapid pedestrian detection method based on computer vision | |
| Benfold et al. | Guiding visual surveillance by tracking human attention. | |
| Zhang et al. | A longitudinal scanline based vehicle trajectory reconstruction method for high-angle traffic video | |
| KR20160062880A (en) | road traffic information management system for g using camera and radar | |
| Kumar et al. | Study of robust and intelligent surveillance in visible and multi-modal framework | |
| CN102447835A (en) | Non-blind area multi-target cooperative tracking method and system | |
| KR101548639B1 (en) | Apparatus for tracking the objects in surveillance camera system and method thereof | |
| AU2021255130B2 (en) | Artificial intelligence and computer vision powered driving-performance assessment | |
| Alvarez et al. | Hierarchical camera auto-calibration for traffic surveillance systems | |
| Stahlschmidt et al. | Applications for a people detection and tracking algorithm using a time-of-flight camera | |
| CN106570490A (en) | Pedestrian real-time tracking method based on fast clustering | |
| CN106228570A (en) | A kind of Truth data determines method and apparatus | |
| Liang et al. | Methods of moving target detection and behavior recognition in intelligent vision monitoring. | |
| KR20110035662A (en) | Intelligent image search method and system using surveillance camera | |
| Bourja et al. | Real time vehicle detection, tracking, and inter-vehicle distance estimation based on stereovision and deep learning using YOLOv3 | |
| Börcs et al. | Dynamic 3D environment perception and reconstruction using a mobile rotating multi-beam Lidar scanner | |
| CN116563793A (en) | Fine-granularity crowd analysis method based on passive WiFi perception | |
| Bhusal | Object detection and tracking in wide area surveillance using thermal imagery | |
| Creusen et al. | ViCoMo: visual context modeling for scene understanding in video surveillance | |
| Bhowmik et al. | A Review on Automatic Traffic Monitoring System |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20170822 |