Skip to content

A minimal web crawler to generate visual site maps

License

Notifications You must be signed in to change notification settings

pbernery/site-mapper

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

#Site Mapper

A minimal web crawler that maps out all dicoverable pages on a given site and prints out dot-file format that can be used to generate a site map graph.

###How to use:

Install casperjs:

$ brew install casperjs --devel

Run the scrip to crawl your website:

$ casperjs sitemap.js https://markusos.github.io/ > map.dot

If you want to generate a site map graph from the dot-file output you need to have Graphviz installed

$ brew install graphviz --with-gts

Run Graphviz on the dot-file with:

$ sfdp -Tsvg map.dot -o sitemap.svg

Result:

alt tag

###License

The MIT License (MIT)

Copyright (c) 2016 Markus Östberg

About

A minimal web crawler to generate visual site maps

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • JavaScript 100.0%