CN105930855A - Vehicle detection method based on deep convolution neural network - Google Patents
Vehicle detection method based on deep convolution neural network Download PDFInfo
- Publication number
- CN105930855A CN105930855A CN201610338615.4A CN201610338615A CN105930855A CN 105930855 A CN105930855 A CN 105930855A CN 201610338615 A CN201610338615 A CN 201610338615A CN 105930855 A CN105930855 A CN 105930855A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- convolutional neural
- checking method
- trained
- picture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/08—Detecting or categorising vehicles
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Multimedia (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Engineering & Computer Science (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Image Analysis (AREA)
Abstract
The invention discloses a vehicle detection method based on a deep convolution neural network. The vehicle detection method comprises the following steps: acquiring road surface pictures in real time through a camera, and normalizing sizes of the pictures; selecting a threshold to segment a road surface vehicle shadow area; determining a vehicle candidate area in the road surface vehicle shadow area; and training the convolution neural network, recognizing the vehicle candidate area by using the trained convolution neural network, and outputting a detection result. According to the vehicle detection method, the convolution neural network is adopted to perform verification, so that the timeliness and accuracy of a whole system are improved.
Description
Technical field
The present invention relates to road safety field, be specifically related to a kind of vehicle checking method based on degree of depth convolutional Neural net.
Background technology
Undoubtedly, along with socioeconomic development, the requirement of the vehicles is the most constantly improved by people, automobile
Occur bringing huge facility to the life of people undoubtedly, change the life style of people, improve the living standard of people.
The automobile pollution of China is very big at present, motor vehicles more than 200,000,000, nearly 100,000,000 of automobile, light production and marketing in 2010 more than 17,000,000.
But being as the increase of automobile pollution, the safety problem that the vehicles are brought easily does not allows people to be ignored, frequently yet
Vehicle accident, heavy casualties and huge property loss to make motor traffic safety problem be increasingly becoming of concern
Focus.According to ASSOCIATE STATISTICS, in annual worldwide road traffic accident, about 10,000,000 people are injured, and wherein severe injury is about
3000000 people, dead 400,000 people, the economic loss that these accidents cause accounts for the 13% of world GDP.By lot of accident is divided
Analysis, the accident caused due to the reason of non-vehicle own reaches 70%: cause of accident mainly with the active safety of driver because have
Close.Traffic safety is to hinder society and a big problem of economic development, and all deeply hurting in countries in the world and area, is therefore subject to
To countries in the world government and the concern of society.Although having worked out many passive security measures to reduce accident
After casualties, but cause vehicle accident basic reason solved the most at all.Research shows, as long as there being collision danger
The 0.5s forward direction driver of danger sounds a warning, it is possible to avoid the car accident that knocks into the back of 60%, the thing of head-on colliding of 30%
Therefore and 50% road surface related accidents;If there being " early warning " time of 1s, the accident of 90% can be avoided to occur.
Summary of the invention
For the deficiency overcoming prior art to exist, the present invention provides a kind of vehicle detection based on degree of depth convolutional Neural net
Method.
The present invention adopts the following technical scheme that
A kind of vehicle checking method based on degree of depth convolutional Neural net, including:
Photographic head Real-time Collection road surface picture, is normalized picture size;
It is partitioned into road vehicles shadow region by selected threshold;
In road vehicles shadow region, determine vehicle candidate region;
Convolutional neural networks is trained, then uses the convolutional neural networks identification vehicle candidate region trained,
Output detections result.
The described convolutional neural networks trained specifically trains the process to be:
S1 utilizes camera collection vehicle sample information, described vehicle sample information to include positive samples pictures and negative sample figure
Sheet, carries out Image semantic classification;
Pretreated vehicle pictures as the input of degree of depth convolutional Neural net, is trained the weights in neutral net by S2.
Described photographic head is specially monocular cam.
Described Image semantic classification includes gray processing and mean filter.
Described S2 use back-propagation algorithm degree of depth convolution net is trained.
Described in road vehicles shadow region, determine that vehicle candidate region specifically uses calculating vehicle length-width ratio, according to
Shade width delimit region to be identified.
It is partitioned into road vehicles shade by selected threshold, particularly as follows:
By pretreated picture, sample area gray value statistics grey value profile;
Calculate average m and variances sigma2;
If σ2> threshold value S, then delete the gray value more than average, average statistical and variance again;
Calculate threshold value T=m-3 σ, use this threshold binarization picture, obtain road vehicles shadow region.
Beneficial effects of the present invention:
The present invention identifies vehicle by convolutional neural networks, it is to avoid traditional recognition method uses the artificial feature extracted
Limitation, convolutional neural networks by representing the best features of object from great amount of samples learning, and therefore accuracy rate is high.
Real-time in order to avoid using sliding window detection to bring reduces problem, and the present invention uses shadow Detection from figure
The position that quick location vehicle exists, then verifies with convolutional neural networks, thus improves the real-time of whole system with accurate
Property.
Accompanying drawing explanation
Fig. 1 is the workflow schematic diagram of the present invention;
Fig. 2 is the schematic flow sheet training neutral net in Fig. 1;
Fig. 3 is the schematic flow sheet of selected threshold;
Fig. 4 determines that the schematic flow sheet of vehicle candidate region.
Detailed description of the invention
Below in conjunction with embodiment and accompanying drawing, the present invention is described in further detail, but embodiments of the present invention are not
It is limited to this.
Embodiment
As Figure 1-Figure 4, a kind of vehicle checking method based on degree of depth convolutional Neural net, including:
Photographic head Real-time Collection road surface picture, carries out pretreatment and normalization to its size, and described pretreatment includes gray scale
Changing and mean filter, described photographic head is monocular cam;
Vehicle shadow region, road surface is gone out by choosing suitable Threshold segmentation;
Owing to general road image 1/3 is the irrelevant information such as sky, mountain, therefore we only need to detect below image 1/3
Region, in general, shade is that illumination is caused by vehicle shelter, and therefore the gray value of general shaded side is lower than road surface,
The most only need to obtain the normal gray value on road surface, i.e. can be partitioned into bottom shadow.
In order to prevent the impact of the land marking such as deceleration strip, word, herein by data and the historical data phase of current statistic
In conjunction with method choose suitable threshold value, judge whether road surface exists deceleration strip, literary composition by assembly average m and variances sigma
The land markings such as word.
The most as shown in Figure 3:
By pretreated picture, sample area gray value statistics grey value profile;
Calculate average m and variances sigma2;
If σ2> threshold value S, then delete the gray value more than average, recalculate average and variance, enter next step, as
Really σ2< threshold value S, then be directly entered next step;
Calculate threshold value T=m-3 σ, use this threshold binarization picture, obtain road vehicles shadow region.
As shown in Figure 4, in road vehicles shadow region, determine vehicle candidate region;
For different vehicles, its length-width ratio is different, by the vehicle length-width ratio that statistics is common, according to shade width
Degree, delimit candidate region to be identified.
Generally in road picture, it is 3:2 by the ratio of shade length and overall height, therefore just can be by vehicle by this ratio
Outline completely from figure.
Convolutional neural networks is trained, then uses the convolutional neural networks identification vehicle candidate region trained,
Output detections result.
It is the input of network owing to convolutional Neural net can accept gray scale picture initial data, therefore chooses in candidate region
After, the output obtaining network with this as the input of network, determine whether vehicle by output.
The process that described convolutional neural networks is specifically trained is:
S1 utilizes camera collection vehicle sample information, described vehicle sample information to include positive samples pictures and negative sample figure
Sheet, carries out Image semantic classification;Obtaining pretreated vehicle as positive samples pictures, described positive sample is the figure comprising vehicle
Sheet, does not comprise the negative sample picture of vehicle, and positive sample size is more than 2000, and negative sample quantity is more than 4000, generally
Negative sample quantity is the twice of positive sample size;
Pretreated vehicle pictures as the input of degree of depth convolutional Neural net, is trained the weights in neutral net by S2,
Specifically use back propagation:
First initialize network weight, can be randomly derived, be then iterated training, specifically comprise the following steps that
First stage, propagated forward, the training of neutral net, its purpose is through existing information and constantly adjusts net
The parameter of network self makes the output of network become closer to actual output, i.e. error is more and more less.For n sample, seek
Look for the minima of Formula Solution, first calculate the error of sample output
1. convolutional layer: assuming that m layer is convolutional layer, m+1 layer is down-sampling layer, then the calculating of m layer jth characteristic pattern
Formula is as follows:
2. down-sampling layer: choose maximum sampling, i.e. choose the maximum feature generation as one's respective area of a region class
Table.
The propagated forward of convolutional neural networks is through continuous convolution and down-sampling, finally by the full articulamentum of multilamellar
Obtain final output
Second stage: back propagation, updates weights W and b.
Weights W and d updated in network by gradient descent method is updated by column, the following is the most former of gradient descent method
Reason:
Repeatedly perform the step in above-mentioned first and second stage, obtain W and b of convergence.
Described Image semantic classification includes gray processing and mean filter, particularly as follows:
Image gray processing, the picture that photographic head is gathered is generally colour picture, and we have only to the half-tone information of image,
The gray value of image is calculated hence with below equation
Gray=0.11B+0.59G+0.3R
Mean filter, there is certain noise in the picture captured by photographic head, therefore reason mean filter carrys out smooth noise,
Meansigma methods mainly by certain pixel neighboring pixel gets to the effect of smooth noise.
Above-described embodiment is the present invention preferably embodiment, but embodiments of the present invention are not by described embodiment
Limit, the change made under other any spirit without departing from the present invention and principle, modify, substitute, combine, simplify,
All should be the substitute mode of equivalence, within being included in protection scope of the present invention.
Claims (7)
1. a vehicle checking method based on degree of depth convolutional Neural net, it is characterised in that comprise the steps:
Photographic head Real-time Collection road surface picture, is normalized picture size;
It is partitioned into road vehicles shadow region by selected threshold;
In road vehicles shadow region, determine vehicle candidate region;
Convolutional neural networks is trained, then uses the convolutional neural networks identification vehicle candidate region trained, output
Testing result.
Vehicle checking method the most according to claim 1, it is characterised in that the described convolutional neural networks trained is concrete
Training process is:
S1 utilizes camera collection vehicle sample information, described vehicle sample information to include positive samples pictures and negative sample picture,
Carry out Image semantic classification;
Pretreated vehicle pictures as the input of degree of depth convolutional Neural net, is trained the weights in neutral net by S2.
Vehicle checking method the most according to claim 1 and 2, it is characterised in that described photographic head is specially monocular shooting
Head.
Vehicle checking method the most according to claim 2, it is characterised in that described Image semantic classification includes gray processing and all
Value filtering.
Vehicle checking method the most according to claim 2, it is characterised in that use back-propagation algorithm to deeply in described S2
Degree convolution net is trained.
Vehicle checking method the most according to claim 1, it is characterised in that described in road vehicles shadow region, determines
Vehicle candidate region specifically uses calculating vehicle length-width ratio, delimits region to be identified according to shade width.
Vehicle checking method the most according to claim 1, it is characterised in that be partitioned into road vehicles by selected threshold cloudy
Territory, shadow zone, particularly as follows:
By pretreated picture, sample area gray value statistics grey value profile;
Calculate average m and variances sigma2;
If σ2> threshold value S, then delete the gray value more than average, and average statistical and variance again, subsequently into next step;As
Really σ2< threshold value S, then be directly entered next step;
Calculate threshold value T=m-3 σ, use this threshold binarization picture, obtain road vehicles shadow region.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610338615.4A CN105930855A (en) | 2016-05-19 | 2016-05-19 | Vehicle detection method based on deep convolution neural network |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610338615.4A CN105930855A (en) | 2016-05-19 | 2016-05-19 | Vehicle detection method based on deep convolution neural network |
Publications (1)
Publication Number | Publication Date |
---|---|
CN105930855A true CN105930855A (en) | 2016-09-07 |
Family
ID=56840963
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610338615.4A Pending CN105930855A (en) | 2016-05-19 | 2016-05-19 | Vehicle detection method based on deep convolution neural network |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105930855A (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107301387A (en) * | 2017-06-16 | 2017-10-27 | 华南理工大学 | A kind of image Dense crowd method of counting based on deep learning |
CN107886055A (en) * | 2017-10-27 | 2018-04-06 | 中国科学院声学研究所 | A kind of retrograde detection method judged for direction of vehicle movement |
CN108230330A (en) * | 2018-01-30 | 2018-06-29 | 北京同方软件股份有限公司 | A kind of quick express highway pavement segmentation and the method for Camera Positioning |
CN109117691A (en) * | 2017-06-23 | 2019-01-01 | 百度在线网络技术(北京)有限公司 | Drivable region detection method, device, equipment and storage medium |
CN111626204A (en) * | 2020-05-27 | 2020-09-04 | 北京伟杰东博信息科技有限公司 | Railway foreign matter invasion monitoring method and system |
TWI734349B (en) * | 2019-08-19 | 2021-07-21 | 威盛電子股份有限公司 | Neural network image identification system and neural network building system and method used therein |
US11556801B2 (en) | 2019-08-19 | 2023-01-17 | Via Technologies, Inc. | Neural network image identification system, neural network building system and method |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103473774A (en) * | 2013-09-09 | 2013-12-25 | 长安大学 | Vehicle locating method based on matching of road surface image characteristics |
CN105184271A (en) * | 2015-09-18 | 2015-12-23 | 苏州派瑞雷尔智能科技有限公司 | Automatic vehicle detection method based on deep learning |
-
2016
- 2016-05-19 CN CN201610338615.4A patent/CN105930855A/en active Pending
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103473774A (en) * | 2013-09-09 | 2013-12-25 | 长安大学 | Vehicle locating method based on matching of road surface image characteristics |
CN105184271A (en) * | 2015-09-18 | 2015-12-23 | 苏州派瑞雷尔智能科技有限公司 | Automatic vehicle detection method based on deep learning |
Non-Patent Citations (1)
Title |
---|
刘公俊: "基于单目视觉的车辆检测与跟踪", 《中国优秀硕士学位论文全文数据库信息科技辑》 * |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107301387A (en) * | 2017-06-16 | 2017-10-27 | 华南理工大学 | A kind of image Dense crowd method of counting based on deep learning |
CN109117691A (en) * | 2017-06-23 | 2019-01-01 | 百度在线网络技术(北京)有限公司 | Drivable region detection method, device, equipment and storage medium |
CN107886055A (en) * | 2017-10-27 | 2018-04-06 | 中国科学院声学研究所 | A kind of retrograde detection method judged for direction of vehicle movement |
CN108230330A (en) * | 2018-01-30 | 2018-06-29 | 北京同方软件股份有限公司 | A kind of quick express highway pavement segmentation and the method for Camera Positioning |
CN108230330B (en) * | 2018-01-30 | 2020-02-07 | 北京同方软件有限公司 | Method for quickly segmenting highway pavement and positioning camera |
TWI734349B (en) * | 2019-08-19 | 2021-07-21 | 威盛電子股份有限公司 | Neural network image identification system and neural network building system and method used therein |
US11556801B2 (en) | 2019-08-19 | 2023-01-17 | Via Technologies, Inc. | Neural network image identification system, neural network building system and method |
CN111626204A (en) * | 2020-05-27 | 2020-09-04 | 北京伟杰东博信息科技有限公司 | Railway foreign matter invasion monitoring method and system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105930855A (en) | Vehicle detection method based on deep convolution neural network | |
CN108090429B (en) | Vehicle type recognition method for graded front face bayonet | |
CN109657716B (en) | Vehicle appearance damage identification method based on deep learning | |
CN105160309B (en) | Three lanes detection method based on morphological image segmentation and region growing | |
CN111460919B (en) | Monocular vision road target detection and distance estimation method based on improved YOLOv3 | |
CN103577809B (en) | A kind of method that traffic above-ground mark based on intelligent driving detects in real time | |
CN103530600B (en) | Licence plate recognition method under complex illumination and system | |
CN106599827A (en) | Small target rapid detection method based on deep convolution neural network | |
CN109389046A (en) | Round-the-clock object identification and method for detecting lane lines for automatic Pilot | |
CN106127137A (en) | A kind of target detection recognizer based on 3D trajectory analysis | |
CN110516633B (en) | Lane line detection method and system based on deep learning | |
CN104881661B (en) | Vehicle checking method based on structural similarity | |
CN111832461B (en) | Method for detecting wearing of non-motor vehicle riding personnel helmet based on video stream | |
KR102105954B1 (en) | System and method for accident risk detection | |
CN111310615A (en) | Small target traffic sign detection method based on multi-scale information and residual error network | |
CN103927548A (en) | Novel vehicle collision avoiding brake behavior detection method | |
CN107886034A (en) | Driving based reminding method, device and vehicle | |
CN113033352B (en) | Real-time mobile traffic violation detection method based on combination of improved target semantic segmentation and target detection model | |
CN106407951A (en) | Monocular vision-based nighttime front vehicle detection method | |
CN117315934A (en) | Expressway traffic flow real-time monitoring and congestion prediction system based on unmanned aerial vehicle | |
CN103605960B (en) | A kind of method for identifying traffic status merged based on different focal video image | |
CN113034378A (en) | Method for distinguishing electric automobile from fuel automobile | |
CN108133231B (en) | Scale-adaptive real-time vehicle detection method | |
CN112991399B (en) | Bus passenger number detection system based on RFS | |
Zou et al. | Road Curb Detection Based on a Deep Learning Framework |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160907 |
|
RJ01 | Rejection of invention patent application after publication |