Skip to content
/ trawl Public
forked from swimlane/trawl

A utility to trawl phishing domains and attempt to identify phishing kits as well as other malicious activity

License

Notifications You must be signed in to change notification settings

iofane/trawl

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

trawl

A set of utilities used to assist with identify potential phishing websites and downloading potentially malicious content.

THIS PROJECT CURRENTLY UNDER DEVELOPMENT AND IT NOT READY FOR TESTING. PLEASE STAR OR WATCH THIS PROJECTS FOR FUTURE UPDATES AS I CONTINUE TO UPDATE IT

About

You can find more information about this tool during my presentation at DerbyCon 2019. Please visit my blog for the slides and a link to the video.

Services

trawl includes the following services (containers):

  • entrails (MongoDB which contains 3 document models)
  • spotter (spotter is used to spot potential malicious URLs)
  • trawler (trawler is used to scrape websites for malicious content)
  • Chum (chum is a RabbitMQ queue used by both spotter and trawler)

trawl is designed with Docker in mind and is catered towards rapid setup and deployment. The general architecture can be seen below:

trawl architecture

Requirements

  • Docker-Compose

Usage

To begin using trawl make sure you have docker and docker-compose installed on your system and then you must clone the repository:

git clone [email protected]:swimlane/trawl.git

change directories into the trawl folder and run

docker-compose up

This will begin creating and setting up all services.

About

A utility to trawl phishing domains and attempt to identify phishing kits as well as other malicious activity

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 97.4%
  • Dockerfile 2.6%