DEV Community

Lia
Lia

Posted on

How to Block Bad Bots with SafeLine WAF

How to Block Bad Bots with SafeLine WAF

Bad bots are everywhere: content scrapers, credential stuffers, vulnerability scanners, and spam senders. The trick is blocking the harmful ones without hurting good crawlers like Google. SafeLine does this with bot detection and a human-verification challenge at the edge.

The problem with a blunt block

Blocking by IP or user-agent alone breaks easily — bots rotate both. And a naive block can also catch search-engine crawlers you want indexing your site. You need to tell automated abuse apart from real users and legitimate bots.

Step 1 — Install SafeLine in front of your site

bash -c "$(curl -fsSLk https://waf.chaitin.com/release/latest/manager.sh)" -- --en
Enter fullscreen mode Exit fullscreen mode

Add your site as the upstream in the console at https://<safeline-ip>:9443.

Step 2 — Turn on bot protection

SafeLine detects automated behavior and can issue a bot challenge (a human-verification step) to clients that look suspicious. A real browser solves it once and proceeds; a scripted bot fails or gets throttled. Legitimate, well-behaved crawlers pass through normally.

Step 3 — Keep good bots working

Add allowlist entries for crawlers you trust (for example, Googlebot) so SEO and indexing are unaffected. SafeLine's heuristics handle the rest of the automated traffic.

Step 4 — Add rate limiting where it helps

Bot blocking pairs well with rate limiting for specific paths — /login against credential stuffing, or an API endpoint against scraping. Set a threshold and SafeLine slows or blocks clients that exceed it.

What you see

The dashboard breaks down bot vs. human traffic and shows which clients were challenged or blocked, so you can tune the allowlist with confidence.

FAQ

Will this hurt my SEO?

No — good crawlers are allowed through; only abusive automated traffic is challenged.

Can I allow specific bots?

Yes — allowlist by user-agent or other traits for crawlers you trust.

Does it stop credential stuffing?

Combined with rate limiting on login paths, yes.

Free tier?

The Community Edition covers 10 apps at 800 QPS for free.


That's it — abusive bots get challenged at the edge while real users and search engines sail through.

Deploy it in minutes:

bash -c "$(curl -fsSLk https://waf.chaitin.com/release/latest/manager.sh)" -- --en
Enter fullscreen mode Exit fullscreen mode

Top comments (0)