-
Notifications
You must be signed in to change notification settings - Fork 1
kangchch/spider_steel
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
分为两个抓取程序 一、抓取公司url：通过分析网站拼接每一页的url（在程序里有注释详解，忘记了看一下），遍历公司的url，存到mongo，(steel_info/company_url),status:0 未抓取 1 已抓取 二、抓取公司详情：从mongo里取status为0的url抓取详情，抓取成功则更新company_url表的status为1，
About
抓取钢铁网公司信息
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published