Skip to content

Aryangp/scraping_coin_market_ignis_tech_intern

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Scrapping the website coinmarketcap.com

This Django project scrap the site for the given coin and get a jobIds for each coin and than get the data from the job id recived previously

Setup

  • Install all the library
pip install -r requirements.txt
  • run the celery worker
celery -A scrapcoin worker --beat -l info
  • for celery to work you need redis so i have given a docker-compose file to setup redis just run the command and add url in env file
docker-compose up
url :- CELERY_BROKER_REDIS_URL=redis:https://localhost:6379
  • Now for the Django do this commands
python3 manage.py makemigrations
python3  manage.py migrate
python3 manage.py runserver

Now you are ready to use it

API Endpoints

  • start scraping and get the jobId postman_sc_intern
  • To get the data from job id postman_sc_intern1

Screenshot of Admin Panel

internship_scrap2

internship_scrap3

internship_scrap4

internship_scrap5

internship_scrap7

internship_scrap6

internship_scrap8

internship_scrap9

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published