Install in 5 minutes

Take control of AI crawler access

Know who's crawling. Decide who gets in. Built on IETF Web Bot Auth and RFC 9421—WordPress plugin or middleware for any stack.

Get WordPress PluginView All Integrations
Most Popular

WordPress? You're 5 minutes away.

Full-featured plugin. No coding. See exactly which AI bots visit your site.

OpenBotAuth for WordPress

Available on WordPress.org

  • Analytics dashboard — see which AI bots visit
  • Per-post control — allow, teaser, or deny
  • AI endpoints — llms.txt, JSON feed, markdown
  • Rate limiting — per crawler limits
Get Installation Guide

Install from WordPress.org:

1. Go to Plugins → Add New
2. Search "OpenBotAuth"
3. Click Install Now
4. Click Activate

Or visit: wordpress.org/plugins/openbotauth

The problem with AI crawlers

AI companies are training on your content. You can't tell who's who.

User-agents lie

Anyone can claim to be "GoogleBot". No verification.

robots.txt is ignored

It's advisory only. No enforcement, no accountability.

CDN lock-in

Bot management at CDN = vendor dependency.

What you get with OpenBotAuth

Cryptographic verification at your origin. Works with any CDN.

Verified Identity

Crawlers sign requests with their private keys. You verify against their public JWKS. No spoofing possible.

Works at Your Origin

Use any CDN—or none. Verification happens at your server using standard HTTP.

Granular Policies

Allow specific crawlers, block others. Rate limit by identity. Per-page rules.

Full Visibility

See exactly who's crawling, how often, and what they access. Export logs. Own your data.

Not on WordPress?

We have SDKs for Node.js, Python, and a zero-code proxy option.

Zero-Code Proxy

No code changes

Node.js

Express / Next.js

Python

FastAPI / Flask

Docker

Container image

View all integration options →
Advanced

Ready to monetize?

Create pay-per-crawl programs for AI companies that want premium access.

How it works

  1. 1Define access tiers with pricing
  2. 2Crawlers enroll in your program
  3. 3Usage is metered automatically
  4. 4Generate invoices from logs

Example tier structure:

tiers:
  - name: Evaluation
    rate_limit: 100/hour
    price: free
  - name: Standard
    rate_limit: 10,000/hour
    price: $0.001/request
  - name: Enterprise
    rate_limit: unlimited
    price: custom

Start controlling AI crawler access today

WordPress plugin installs in 5 minutes. Other integrations available.

Get WordPress PluginView All Options