Settings

Theme

Show HN: AI crawler access control for WordPress (allow, deny, teaser previews)

wordpress.org

1 points by hammadtariq · 1 comment

Reader

1 thread
hammadtariqOP

I just got this WordPress plugin approved on wp.org.

It lets site owners control automated access from AI crawlers and agents with per-site and per-post rules: allow, deny, teaser previews, and rate limits. It can also return 402 if you want to experiment with paid access.

If a crawler signs requests, the plugin can verify RFC 9421 HTTP Message Signatures. Most crawlers do not sign yet, but I wanted the path to be there.

It also publishes llms.txt, a JSON feed, and per-post Markdown endpoints.

Source and other integration surfaces (Node, Python, proxy): https://github.com/OpenBotAuth/openbotauth https://openbotauth.com/developers

If you run a content site or a crawler team, I would love feedback on signing defaults and replay protection expectations.

Keyboard Shortcuts

j
Next item
k
Previous item
o / Enter
Open selected item
?
Show this help
Esc
Close modal / clear selection