Skip to content

itzujun/meizi

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

妹子爬虫

-爬虫多进程

for per in downlist:
    threads = []
    for url in per:  # 开启多线程下载
        filename = '%s/%s/%s.jpg' % (os.path.abspath('.'), dirName, k)
        k = k + 1
        t = Thread(target=self.download, args=[filename, url])
        t.start()
        threads.append(t)
    for t in threads:  # 开启守护进程
        t.join()

爬虫结果

About

网络妹子网站数据爬虫

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages