Skip to content

A tiny Python clone of https://archive.org/web/ for your own personal websites.

License

Notifications You must be signed in to change notification settings

nefter/web-archiver

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

web-archiver

A tiny Python clone of https://archive.org/web/ for your own personal websites.

To use simply install

$ pip install -r requirements.txt

and then add your sites into the file sites. Then to run just used

$ python run.py

To check out your files, goto the output directory and use

$ python3 -m http.server

To-do

  • Archive site with wget --recursive --no-clobber --page-requisites --html-extension --convert-links --restrict-file-names=windows --domains DOMAIN.COM https://DOMAIN.COM/ with date
  • Take screenshot with
from selenium import webdriver

browser = webdriver.Firefox()
browser.get('https://www.google.com/')
browser.save_screenshot('screenshot.png')
browser.quit()
  • Generate site to be able to traverse the sites easily. Index page for all pages. One index page for each web archive with screenshots/dates that take you to the actual page.

About

A tiny Python clone of https://archive.org/web/ for your own personal websites.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%