Skip to content
/ linkedin-scraper Public

• Developed an automation tool to scrape Linkedin profiles information. • It captures profile urls using filtered search URL. • Saves each scraped profile information into csv file. • Tech Stack: Selenium, BeautifulSoup, Python

2 stars 1 fork Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

Project-Based-Learning-IT/linkedin-scraper

BranchesTags

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

53 Commits
.ipynb_checkpoints
.ipynb_checkpoints
 
 
__pycache__
__pycache__
 
 
.gitignore
.gitignore
 
 
README.md
README.md
 
 
Scraper.ipynb
Scraper.ipynb
 
 
atharva.csv
atharva.csv
 
 
chromedriver
chromedriver
 
 
chromedriver.exe
chromedriver.exe
 
 
chromedriverMac
chromedriverMac
 
 
combineData.py
combineData.py
 
 
combinedDataset.csv
combinedDataset.csv
 
 
mayank.csv
mayank.csv
 
 
profile_url_scraper.py
profile_url_scraper.py
 
 
profile_urls.csv
profile_urls.csv
 
 
scraper.py
scraper.py
 
 
scraperHeadless.py
scraperHeadless.py
 
 
siddesh.csv
siddesh.csv
 
 
sidhant.csv
sidhant.csv
 
 

Repository files navigation

linkedin-scraper

Main project Project Partner

Tech stack used

  • Selenium
  • Beautiful Soup

Warning

  • Use a dummy account as linkedin doesn't allow multiple profile visits using a automation tool.
  • Your account might get restricted or blocked
  • You might be asked to verify your identity using government ID when your account is restricted.

Guide

  • For chrome driver error add chrome driver folder to path using windows environment variable

Fields to scrape using scraper.py (Scrolling and clicking):

  • Name
  • Skills

Scraped data is stored in csv format in {your_name}.csv

To change the parameters for your execution search #CHANGE to see all the places change is necessary in file scraper.py.

Add email and password for login in code.

Fields to scrape using Scraper.ipynb:

  • Everything about is profile quickly fetched in a csv

VIIT College Students and Alumnis search page URL is used to generate profile urls using profile_url_scraper.py and then run scraper.py or scraper.ipynb

About

• Developed an automation tool to scrape Linkedin profiles information. • It captures profile urls using filtered search URL. • Saves each scraped profile information into csv file. • Tech Stack: Selenium, BeautifulSoup, Python

Topics

python scraper automation linkedin selenium python3 profiles beautifulsoup4

Resources

Readme
Activity
Custom properties

Stars

2 stars

Watchers

1 watching

Forks

1 fork
Report repository

Releases

No releases published

Packages

 
 
 

Contributors 4

  •  
  •  
  •  
  •  

Languages