In this talk, we present WebShield, a small open-source Python daemon that analyzes Tempesta FW, an open-source web accelerator, access logs and dynamically classifies and blocks bad bots.
* Bots' types and characteristics: L7 DDoS, password crackers, scrapers, carting/checkout abuse and others.
* How to employ users’ access patterns to classify bad bots.
* How to efficiently deliver web-server access logs to an analytics database (e.g., ClickHouse).
* Traffic fingerprints (JA3, JA4, p0f): computation and properties
* Tempesta Fingerprints: lightweight fingerprints designed for automatic web clients clustering.
* How to correlate multiple traffic characteristics and catch lazy bot developers.
* Baseline models for access-log analytics and how to validate them.
* How to block large botnets without blocking half the Internet.
* Scoring, behavioral analysis, and other advanced techniques.