Skip to content

A casperjs script that crawls one or more pages on your site and tests for broken <a>, <link>, <script> and <img> links.

Notifications You must be signed in to change notification settings

jleonard/casper-crawl

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

19 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Crawl for CasperJS

A CasperJS script that crawls one or more pages on your site and tests for broken <a>, <link>, <script> and <img> links.

Install Dependencies

Install PhantomJs and CasperJs

Installation

npm install --save casper-crawl

Basic Usage : Testing a single page

casperjs crawl.js https://my-website.com

Testing multiple pages on a website

casperjs crawl.js https://my-website.com --pages=about,contact,careers/apply

This will test for broken urls on

  • https://my-website.com/about
  • https://my-website.com/contact
  • https://my-website.com/careers/apply

Passing in http authentication variables

casperjs crawl.js https://my-website.com --httpUser=username --httpPassword=password

Dealing with ssl issues over https

casperjs crawl.js --web-security=no --ignore-ssl-errors=true https://localhost:4000

About

A casperjs script that crawls one or more pages on your site and tests for broken <a>, <link>, <script> and <img> links.

Resources

Stars

Watchers

Forks

Packages

No packages published