This python code simply crawls the given web addresses for potential emails and saves those in a text file. Web URLs have to be specified in a text file separated by newline.

This can be helpful script to automate the task of finding relevant email addresses provided one knows the associated web URLs.

The python modules are needed in order to use this library.

sys
urllib

Clone the repository and use the following code. Run the command directly from the console with command line arguments to the file emailcrawler.py. The command line arguments are explained as:

emailcrawler.py [filename]

For example,

$ python emailcrawler.py example.txt

example.txt contains newline separated web URLs on which the email addresses are to be located and saved. This command saves three text files, namely, email_addresses.txt (containing email addresses found), email_addresses_withurl.txt (contains email addresses mapped with associated urls) and info.txt (general information on number of pages crawled and number od emails found).

MIT License