A fluent Lib to wrap selenium and other utilities for a web crawler.
Pipeline |
---|
Metrics | |
---|---|
Simple Url nagigation example:
var crawler = new Crawler(logFactory);
crawler.Initialize(new Behavior())
.GoToUrl("https://github.com/afborgesDev/CrawlerWave", out _);
Get Element text
var crawler = new Crawler(logFactory);
crawler.Initialize(new Behavior())
.GoToUrl("https://github.com/afborgesDev/CrawlerWave", out _)
.ElementInnerText(WebElement.xPath("//*[@id='js-repo-pjax-container']/div[1]/div/h1"), out var elementText);
More Examples on Tests or on Wiki(WIP)