Skip to content

Commit

Permalink
added shape and kasada
Browse files Browse the repository at this point in the history
  • Loading branch information
pigivinci committed Jul 6, 2022
1 parent a81d7e9 commit 34bf1ac
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 5 deletions.
8 changes: 4 additions & 4 deletions Pages/Antibot/Kasada.md
Original file line number Diff line number Diff line change
@@ -1,15 +1,15 @@
# Kasada

## What is Akamai Bot Manager?
## What is Kasada?
[Kasada ](https://www.kasada.io/ "Kasada") is one of the new anti-bot solution on the market.

## Our View on Akamai Bot Manager
## Our View on Kasada

### How to Identify Akamai Bot Manager
### How to Identify Kasada
Unluckily [Wappalyzer Chrome Extension](https://github.com/reanalytics-databoutique/webscraping-open-doc/blob/0386528f99a1209a538f6d042e859cd9933011c8/Pages/Tools/Wappalyzer.md) does not work in this case but the websites protected with this solution have a peculiar behaviour.
The first request to the website returns a 429 error (visible only from the Network inspection in the browser's developer tools), then redirect to the same page that works properly. This second request added some elements in the response headers like "x-kpsdk-ct"

### Recommended approach to Akamai Bot Manager
### Recommended approach to Kasada
**BEST CHOICE**: at the moment, the best approach is a [Playwright](https://github.com/reanalytics-databoutique/webscraping-open-doc/blob/main/Pages/Tools/Playwright.md) + [Stealth](https://github.com/reanalytics-databoutique/webscraping-open-doc/blob/main/Pages/Tools/Playwright_stealth.md) but result can depend from the hardware where the scraper is executed.

### Reference and interesting links
Expand Down
2 changes: 1 addition & 1 deletion Pages/Antibot/Shape.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@
### How to Identify Shape Bot Defence
[Wappalyzer Chrome Extension](https://github.com/reanalytics-databoutique/webscraping-open-doc/blob/0386528f99a1209a538f6d042e859cd9933011c8/Pages/Tools/Wappalyzer.md) doesn't seem to recognize it, we've noticed that certain websites protected by Shape, if opened by a browser in incognito mode and with developer tools tab opened, they stop to work. Closing the developer tools tab, they work again.

### Recommended approach to Akamai Bot Manager
### Recommended approach to Shape Bot Defence
**BEST CHOICE**: at the moment, the best approach is a [Playwright](https://github.com/reanalytics-databoutique/webscraping-open-doc/blob/main/Pages/Tools/Playwright.md) + [Stealth](https://github.com/reanalytics-databoutique/webscraping-open-doc/blob/main/Pages/Tools/Playwright_stealth.md) but cannot be enough. The scraper should mimic a plausible user interaction with the website, we'll share an example soon.

### Reference and interesting links
Expand Down

0 comments on commit 34bf1ac

Please sign in to comment.