CN105930855A - Vehicle detection method based on deep convolution neural network - Google Patents

Vehicle detection method based on deep convolution neural network Download PDF

Info

Publication number
CN105930855A
CN105930855A CN201610338615.4A CN201610338615A CN105930855A CN 105930855 A CN105930855 A CN 105930855A CN 201610338615 A CN201610338615 A CN 201610338615A CN 105930855 A CN105930855 A CN 105930855A
Authority
CN
China
Prior art keywords
vehicle
convolutional neural
checking method
trained
picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610338615.4A
Other languages
Chinese (zh)
Inventor
周智恒
康磊
邝沛江
戴铭
赵汝正
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
South China University of Technology SCUT
Original Assignee
South China University of Technology SCUT
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by South China University of Technology SCUT filed Critical South China University of Technology SCUT
Priority to CN201610338615.4A priority Critical patent/CN105930855A/en
Publication of CN105930855A publication Critical patent/CN105930855A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/08Detecting or categorising vehicles

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Multimedia (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Image Analysis (AREA)

Abstract

The invention discloses a vehicle detection method based on a deep convolution neural network. The vehicle detection method comprises the following steps: acquiring road surface pictures in real time through a camera, and normalizing sizes of the pictures; selecting a threshold to segment a road surface vehicle shadow area; determining a vehicle candidate area in the road surface vehicle shadow area; and training the convolution neural network, recognizing the vehicle candidate area by using the trained convolution neural network, and outputting a detection result. According to the vehicle detection method, the convolution neural network is adopted to perform verification, so that the timeliness and accuracy of a whole system are improved.

Description

A kind of vehicle checking method based on degree of depth convolutional Neural net
Technical field
The present invention relates to road safety field, be specifically related to a kind of vehicle checking method based on degree of depth convolutional Neural net.
Background technology
Undoubtedly, along with socioeconomic development, the requirement of the vehicles is the most constantly improved by people, automobile Occur bringing huge facility to the life of people undoubtedly, change the life style of people, improve the living standard of people. The automobile pollution of China is very big at present, motor vehicles more than 200,000,000, nearly 100,000,000 of automobile, light production and marketing in 2010 more than 17,000,000. But being as the increase of automobile pollution, the safety problem that the vehicles are brought easily does not allows people to be ignored, frequently yet Vehicle accident, heavy casualties and huge property loss to make motor traffic safety problem be increasingly becoming of concern Focus.According to ASSOCIATE STATISTICS, in annual worldwide road traffic accident, about 10,000,000 people are injured, and wherein severe injury is about 3000000 people, dead 400,000 people, the economic loss that these accidents cause accounts for the 13% of world GDP.By lot of accident is divided Analysis, the accident caused due to the reason of non-vehicle own reaches 70%: cause of accident mainly with the active safety of driver because have Close.Traffic safety is to hinder society and a big problem of economic development, and all deeply hurting in countries in the world and area, is therefore subject to To countries in the world government and the concern of society.Although having worked out many passive security measures to reduce accident After casualties, but cause vehicle accident basic reason solved the most at all.Research shows, as long as there being collision danger The 0.5s forward direction driver of danger sounds a warning, it is possible to avoid the car accident that knocks into the back of 60%, the thing of head-on colliding of 30% Therefore and 50% road surface related accidents;If there being " early warning " time of 1s, the accident of 90% can be avoided to occur.
Summary of the invention
For the deficiency overcoming prior art to exist, the present invention provides a kind of vehicle detection based on degree of depth convolutional Neural net Method.
The present invention adopts the following technical scheme that
A kind of vehicle checking method based on degree of depth convolutional Neural net, including:
Photographic head Real-time Collection road surface picture, is normalized picture size;
It is partitioned into road vehicles shadow region by selected threshold;
In road vehicles shadow region, determine vehicle candidate region;
Convolutional neural networks is trained, then uses the convolutional neural networks identification vehicle candidate region trained, Output detections result.
The described convolutional neural networks trained specifically trains the process to be:
S1 utilizes camera collection vehicle sample information, described vehicle sample information to include positive samples pictures and negative sample figure Sheet, carries out Image semantic classification;
Pretreated vehicle pictures as the input of degree of depth convolutional Neural net, is trained the weights in neutral net by S2.
Described photographic head is specially monocular cam.
Described Image semantic classification includes gray processing and mean filter.
Described S2 use back-propagation algorithm degree of depth convolution net is trained.
Described in road vehicles shadow region, determine that vehicle candidate region specifically uses calculating vehicle length-width ratio, according to Shade width delimit region to be identified.
It is partitioned into road vehicles shade by selected threshold, particularly as follows:
By pretreated picture, sample area gray value statistics grey value profile;
Calculate average m and variances sigma2
If σ2> threshold value S, then delete the gray value more than average, average statistical and variance again;
Calculate threshold value T=m-3 σ, use this threshold binarization picture, obtain road vehicles shadow region.
Beneficial effects of the present invention:
The present invention identifies vehicle by convolutional neural networks, it is to avoid traditional recognition method uses the artificial feature extracted Limitation, convolutional neural networks by representing the best features of object from great amount of samples learning, and therefore accuracy rate is high.
Real-time in order to avoid using sliding window detection to bring reduces problem, and the present invention uses shadow Detection from figure The position that quick location vehicle exists, then verifies with convolutional neural networks, thus improves the real-time of whole system with accurate Property.
Accompanying drawing explanation
Fig. 1 is the workflow schematic diagram of the present invention;
Fig. 2 is the schematic flow sheet training neutral net in Fig. 1;
Fig. 3 is the schematic flow sheet of selected threshold;
Fig. 4 determines that the schematic flow sheet of vehicle candidate region.
Detailed description of the invention
Below in conjunction with embodiment and accompanying drawing, the present invention is described in further detail, but embodiments of the present invention are not It is limited to this.
Embodiment
As Figure 1-Figure 4, a kind of vehicle checking method based on degree of depth convolutional Neural net, including:
Photographic head Real-time Collection road surface picture, carries out pretreatment and normalization to its size, and described pretreatment includes gray scale Changing and mean filter, described photographic head is monocular cam;
Vehicle shadow region, road surface is gone out by choosing suitable Threshold segmentation;
Owing to general road image 1/3 is the irrelevant information such as sky, mountain, therefore we only need to detect below image 1/3 Region, in general, shade is that illumination is caused by vehicle shelter, and therefore the gray value of general shaded side is lower than road surface, The most only need to obtain the normal gray value on road surface, i.e. can be partitioned into bottom shadow.
In order to prevent the impact of the land marking such as deceleration strip, word, herein by data and the historical data phase of current statistic In conjunction with method choose suitable threshold value, judge whether road surface exists deceleration strip, literary composition by assembly average m and variances sigma The land markings such as word.
The most as shown in Figure 3:
By pretreated picture, sample area gray value statistics grey value profile;
Calculate average m and variances sigma2
If σ2> threshold value S, then delete the gray value more than average, recalculate average and variance, enter next step, as Really σ2< threshold value S, then be directly entered next step;
Calculate threshold value T=m-3 σ, use this threshold binarization picture, obtain road vehicles shadow region.
As shown in Figure 4, in road vehicles shadow region, determine vehicle candidate region;
For different vehicles, its length-width ratio is different, by the vehicle length-width ratio that statistics is common, according to shade width Degree, delimit candidate region to be identified.
Generally in road picture, it is 3:2 by the ratio of shade length and overall height, therefore just can be by vehicle by this ratio Outline completely from figure.
Convolutional neural networks is trained, then uses the convolutional neural networks identification vehicle candidate region trained, Output detections result.
It is the input of network owing to convolutional Neural net can accept gray scale picture initial data, therefore chooses in candidate region After, the output obtaining network with this as the input of network, determine whether vehicle by output.
The process that described convolutional neural networks is specifically trained is:
S1 utilizes camera collection vehicle sample information, described vehicle sample information to include positive samples pictures and negative sample figure Sheet, carries out Image semantic classification;Obtaining pretreated vehicle as positive samples pictures, described positive sample is the figure comprising vehicle Sheet, does not comprise the negative sample picture of vehicle, and positive sample size is more than 2000, and negative sample quantity is more than 4000, generally Negative sample quantity is the twice of positive sample size;
Pretreated vehicle pictures as the input of degree of depth convolutional Neural net, is trained the weights in neutral net by S2, Specifically use back propagation:
First initialize network weight, can be randomly derived, be then iterated training, specifically comprise the following steps that
First stage, propagated forward, the training of neutral net, its purpose is through existing information and constantly adjusts net The parameter of network self makes the output of network become closer to actual output, i.e. error is more and more less.For n sample, seek Look for the minima of Formula Solution, first calculate the error of sample output
E N ( W , b ; x , y ) = 1 2 Σ n = 1 N Σ k = 1 c ( t k n - y k n ) 2
1. convolutional layer: assuming that m layer is convolutional layer, m+1 layer is down-sampling layer, then the calculating of m layer jth characteristic pattern Formula is as follows:
x j m = f ( Σ i ∈ M j x i m - 1 * w i j m + b j m )
2. down-sampling layer: choose maximum sampling, i.e. choose the maximum feature generation as one's respective area of a region class Table.
The propagated forward of convolutional neural networks is through continuous convolution and down-sampling, finally by the full articulamentum of multilamellar Obtain final output
Second stage: back propagation, updates weights W and b.
Weights W and d updated in network by gradient descent method is updated by column, the following is the most former of gradient descent method Reason:
W i j m = W i j m - α ∂ ∂ W i j m E ( W , b )
b i m = b i m - α ∂ ∂ b i m E ( W , b )
Repeatedly perform the step in above-mentioned first and second stage, obtain W and b of convergence.
Described Image semantic classification includes gray processing and mean filter, particularly as follows:
Image gray processing, the picture that photographic head is gathered is generally colour picture, and we have only to the half-tone information of image, The gray value of image is calculated hence with below equation
Gray=0.11B+0.59G+0.3R
Mean filter, there is certain noise in the picture captured by photographic head, therefore reason mean filter carrys out smooth noise, Meansigma methods mainly by certain pixel neighboring pixel gets to the effect of smooth noise.
Above-described embodiment is the present invention preferably embodiment, but embodiments of the present invention are not by described embodiment Limit, the change made under other any spirit without departing from the present invention and principle, modify, substitute, combine, simplify, All should be the substitute mode of equivalence, within being included in protection scope of the present invention.

Claims (7)

1. a vehicle checking method based on degree of depth convolutional Neural net, it is characterised in that comprise the steps:
Photographic head Real-time Collection road surface picture, is normalized picture size;
It is partitioned into road vehicles shadow region by selected threshold;
In road vehicles shadow region, determine vehicle candidate region;
Convolutional neural networks is trained, then uses the convolutional neural networks identification vehicle candidate region trained, output Testing result.
Vehicle checking method the most according to claim 1, it is characterised in that the described convolutional neural networks trained is concrete Training process is:
S1 utilizes camera collection vehicle sample information, described vehicle sample information to include positive samples pictures and negative sample picture, Carry out Image semantic classification;
Pretreated vehicle pictures as the input of degree of depth convolutional Neural net, is trained the weights in neutral net by S2.
Vehicle checking method the most according to claim 1 and 2, it is characterised in that described photographic head is specially monocular shooting Head.
Vehicle checking method the most according to claim 2, it is characterised in that described Image semantic classification includes gray processing and all Value filtering.
Vehicle checking method the most according to claim 2, it is characterised in that use back-propagation algorithm to deeply in described S2 Degree convolution net is trained.
Vehicle checking method the most according to claim 1, it is characterised in that described in road vehicles shadow region, determines Vehicle candidate region specifically uses calculating vehicle length-width ratio, delimits region to be identified according to shade width.
Vehicle checking method the most according to claim 1, it is characterised in that be partitioned into road vehicles by selected threshold cloudy Territory, shadow zone, particularly as follows:
By pretreated picture, sample area gray value statistics grey value profile;
Calculate average m and variances sigma2
If σ2> threshold value S, then delete the gray value more than average, and average statistical and variance again, subsequently into next step;As Really σ2< threshold value S, then be directly entered next step;
Calculate threshold value T=m-3 σ, use this threshold binarization picture, obtain road vehicles shadow region.
CN201610338615.4A 2016-05-19 2016-05-19 Vehicle detection method based on deep convolution neural network Pending CN105930855A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610338615.4A CN105930855A (en) 2016-05-19 2016-05-19 Vehicle detection method based on deep convolution neural network

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610338615.4A CN105930855A (en) 2016-05-19 2016-05-19 Vehicle detection method based on deep convolution neural network

Publications (1)

Publication Number Publication Date
CN105930855A true CN105930855A (en) 2016-09-07

Family

ID=56840963

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610338615.4A Pending CN105930855A (en) 2016-05-19 2016-05-19 Vehicle detection method based on deep convolution neural network

Country Status (1)

Country Link
CN (1) CN105930855A (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107301387A (en) * 2017-06-16 2017-10-27 华南理工大学 A kind of image Dense crowd method of counting based on deep learning
CN107886055A (en) * 2017-10-27 2018-04-06 中国科学院声学研究所 A kind of retrograde detection method judged for direction of vehicle movement
CN108230330A (en) * 2018-01-30 2018-06-29 北京同方软件股份有限公司 A kind of quick express highway pavement segmentation and the method for Camera Positioning
CN109117691A (en) * 2017-06-23 2019-01-01 百度在线网络技术(北京)有限公司 Drivable region detection method, device, equipment and storage medium
CN111626204A (en) * 2020-05-27 2020-09-04 北京伟杰东博信息科技有限公司 Railway foreign matter invasion monitoring method and system
TWI734349B (en) * 2019-08-19 2021-07-21 威盛電子股份有限公司 Neural network image identification system and neural network building system and method used therein
US11556801B2 (en) 2019-08-19 2023-01-17 Via Technologies, Inc. Neural network image identification system, neural network building system and method

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103473774A (en) * 2013-09-09 2013-12-25 长安大学 Vehicle locating method based on matching of road surface image characteristics
CN105184271A (en) * 2015-09-18 2015-12-23 苏州派瑞雷尔智能科技有限公司 Automatic vehicle detection method based on deep learning

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103473774A (en) * 2013-09-09 2013-12-25 长安大学 Vehicle locating method based on matching of road surface image characteristics
CN105184271A (en) * 2015-09-18 2015-12-23 苏州派瑞雷尔智能科技有限公司 Automatic vehicle detection method based on deep learning

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
刘公俊: "基于单目视觉的车辆检测与跟踪", 《中国优秀硕士学位论文全文数据库信息科技辑》 *

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107301387A (en) * 2017-06-16 2017-10-27 华南理工大学 A kind of image Dense crowd method of counting based on deep learning
CN109117691A (en) * 2017-06-23 2019-01-01 百度在线网络技术(北京)有限公司 Drivable region detection method, device, equipment and storage medium
CN107886055A (en) * 2017-10-27 2018-04-06 中国科学院声学研究所 A kind of retrograde detection method judged for direction of vehicle movement
CN108230330A (en) * 2018-01-30 2018-06-29 北京同方软件股份有限公司 A kind of quick express highway pavement segmentation and the method for Camera Positioning
CN108230330B (en) * 2018-01-30 2020-02-07 北京同方软件有限公司 Method for quickly segmenting highway pavement and positioning camera
TWI734349B (en) * 2019-08-19 2021-07-21 威盛電子股份有限公司 Neural network image identification system and neural network building system and method used therein
US11556801B2 (en) 2019-08-19 2023-01-17 Via Technologies, Inc. Neural network image identification system, neural network building system and method
CN111626204A (en) * 2020-05-27 2020-09-04 北京伟杰东博信息科技有限公司 Railway foreign matter invasion monitoring method and system

Similar Documents

Publication Publication Date Title
CN105930855A (en) Vehicle detection method based on deep convolution neural network
CN108090429B (en) Vehicle type recognition method for graded front face bayonet
CN109657716B (en) Vehicle appearance damage identification method based on deep learning
CN105160309B (en) Three lanes detection method based on morphological image segmentation and region growing
CN111460919B (en) Monocular vision road target detection and distance estimation method based on improved YOLOv3
CN103577809B (en) A kind of method that traffic above-ground mark based on intelligent driving detects in real time
CN103530600B (en) Licence plate recognition method under complex illumination and system
CN106599827A (en) Small target rapid detection method based on deep convolution neural network
CN109389046A (en) Round-the-clock object identification and method for detecting lane lines for automatic Pilot
CN106127137A (en) A kind of target detection recognizer based on 3D trajectory analysis
CN110516633B (en) Lane line detection method and system based on deep learning
CN104881661B (en) Vehicle checking method based on structural similarity
CN111832461B (en) Method for detecting wearing of non-motor vehicle riding personnel helmet based on video stream
KR102105954B1 (en) System and method for accident risk detection
CN111310615A (en) Small target traffic sign detection method based on multi-scale information and residual error network
CN103927548A (en) Novel vehicle collision avoiding brake behavior detection method
CN107886034A (en) Driving based reminding method, device and vehicle
CN113033352B (en) Real-time mobile traffic violation detection method based on combination of improved target semantic segmentation and target detection model
CN106407951A (en) Monocular vision-based nighttime front vehicle detection method
CN117315934A (en) Expressway traffic flow real-time monitoring and congestion prediction system based on unmanned aerial vehicle
CN103605960B (en) A kind of method for identifying traffic status merged based on different focal video image
CN113034378A (en) Method for distinguishing electric automobile from fuel automobile
CN108133231B (en) Scale-adaptive real-time vehicle detection method
CN112991399B (en) Bus passenger number detection system based on RFS
Zou et al. Road Curb Detection Based on a Deep Learning Framework

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20160907

RJ01 Rejection of invention patent application after publication