A tiny Python clone of https://archive.org/web/ for your own personal websites.
To use simply install
$ pip install -r requirements.txt
and then add your sites into the file sites
. Then to run just used
$ python run.py
To check out your files, goto the output
directory and use
$ python3 -m http.server
- Archive site with
wget --recursive --no-clobber --page-requisites --html-extension --convert-links --restrict-file-names=windows --domains DOMAIN.COM https://DOMAIN.COM/ with date
- Take screenshot with
from selenium import webdriver
browser = webdriver.Firefox()
browser.get('https://www.google.com/')
browser.save_screenshot('screenshot.png')
browser.quit()
- Generate site to be able to traverse the sites easily. Index page for all pages. One index page for each web archive with screenshots/dates that take you to the actual page.