Skip to content

A fluent Lib to wrap selenium and other utilities for a web crawler.

License

Notifications You must be signed in to change notification settings

afborgesDev/CrawlerWave

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

CrawlerWave

A fluent Lib to wrap selenium and other utilities for a web crawler.

Pipeline
.NET

NuGet

Metrics
Bugs Code Smells
Coverage Duplicated Lines (%)
Lines of Code Maintainability Rating
Quality Gate Status Reliability Rating
Security Rating Technical Debt
Vulnerabilities

Usage

Simple Url nagigation example:

var crawler = new Crawler(logFactory);

crawler.Initialize(new Behavior())
       .GoToUrl("https://github.com/afborgesDev/CrawlerWave", out _);

Get Element text

var crawler = new Crawler(logFactory);

crawler.Initialize(new Behavior())
       .GoToUrl("https://github.com/afborgesDev/CrawlerWave", out _)
       .ElementInnerText(WebElement.xPath("//*[@id='js-repo-pjax-container']/div[1]/div/h1"), out var elementText);

More Examples on Tests or on Wiki(WIP)