Skip to content

This is a collection of small tools for scraping and other web related tasks

Notifications You must be signed in to change notification settings

sethvoid/webtools

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Web tools

Content

  • Deadlink checker
  • PDF to image converter
  • Ripper lookip (ip address lookup)
  • Website footprinter
  • Photo ripper More to be added at a later date

Deadlink checker

This is a simple tool to collect all available website links on a website using both the sitemap and spidering and checking they are all returning a 200. Anything else is just pants.

PDF to Image converter

Simple tool to convert a pdf into images, as you know images are easyer to store than pdf's and certainly easyer to use

Ripper

Script to input an ip address and get the RIPE lookup for that ip address

Website footprinter

This is a tool developed to ensure that backups have come back, its a comparitor taking a website from a set time and saving all the pages as hash values (content only no script or css) and then running a comparison with the current version, this script is useful for identifying which pages on a site have recently changed.

photo ripper

Takes a page, scrapes it for image links, goes to the links and downloads the images, removes any meta data from the images, and saves them to a location.

Disclaimer

As always with all my stuff, please don't use it for anything illegal, and don't use it for goverment or corperate spying.

About

This is a collection of small tools for scraping and other web related tasks

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages