Free
£0forever
The llms.txt generator. Watermarked share card. No account.
Generate freeThe friendliest tier is free. The honest one is £15.
Lite
£15one-time
Generator + 30 days rolling dashboard history on 3 domains.
Buy Lite £15Pro
£9per month
Unlimited history. Hosted endpoint. Weekly digest. 10 domains. 7-day trial.
Start 7-day trial| Feature | Free | Lite | Pro |
|---|---|---|---|
| llms.txt generator | Yes | Yes | Yes |
| Watermarked share card | Yes | No watermark | No watermark |
| Hosted endpoint | No | No | Yes |
| Dashboard | No | 30 days rolling | Unlimited history |
| Verified-IP green ticks | No | Yes | Yes |
| Weekly digest email | No | No | Yes |
| Install-issue surfacing | No | Yes | Yes |
| Domains | 1 | 3 | 10 |
| 14-day money back | n/a | Yes (UK Consumer Rights) | First month |
The free tier is the friendliest version. The paid tiers are where we stay alive. You'll know within a week whether the dashboard is worth £9/mo to you. If it isn't, the £15 Lite still buys you the analytics for 30 days. Cancel any time on Pro and your data stays accessible for 14 days.
Real questions, not the marketing kind.
How does WhoCrawls actually log a hit?
Two paths. (a) You add a one-line snippet to your site, and any AI crawler that loads the page pings our edge endpoint. (b) You host your llms.txt at our subdomain (yourid.whocrawls.com/llms.txt), and any bot that fetches it gets logged server-side. Path (b) catches crawlers that skip JavaScript.
Why should I care which AI bots crawl me?
Two reasons. First, if GPTBot never visits, ChatGPT can't reference your docs. Second, if PerplexityBot stops crawling a key page, that's a signal something broke (a redirect, a 404, a robots.txt change). You want to know.
What's an llms.txt and do I need one?
It's a markdown file at /llms.txt that tells AI crawlers what your site is about and which pages matter. Think sitemap.xml but for language models. You don't strictly need one. But if you have docs you want cited in AI answers, having a clean llms.txt helps.
Do you track my visitors?
No. Zero. We log bot user-agents. That's it. No IP addresses for humans, no cookies, no fingerprinting, no analytics SDK. Our privacy policy is unusually short for that reason.
Will the snippet slow my site down?
The snippet is a 38-byte <link> tag. It does nothing on page load. It's a reference for bots, not a script. There's no measurable impact.
What if a bot fakes its user-agent?
We check the source IP against the bot's published IP range. Verified hits get a green tick. Spoofed hits get a question mark. You see both, you can decide what counts.
Why £15 one-time for Lite?
Because some people don't want subscriptions and we don't want to lose them. £15 buys you the dashboard and 30 days of rolling history. If you keep getting value at day 31, upgrade to Pro for £9/mo.
What's the refund policy?
UK Consumer Rights Act, 14 days no-questions. If you bought Lite and changed your mind before day 14, email us and we refund. If you bought Pro, your first month gets a refund the same way. After that, just cancel and we don't charge another period.
Which bots do you track?
GPTBot (OpenAI), ChatGPT-User (OpenAI), ClaudeBot (Anthropic), Claude-Web (Anthropic), PerplexityBot (Perplexity), Applebot-Extended (Apple), Google-Extended (Google), Amazonbot (Amazon), Meta-ExternalAgent (Meta), Bytespider (ByteDance), Cohere-AI (Cohere), DiffBot. The list lives at whocrawls.com/bots and updates when bot providers ship new agents.
Is this affiliated with the official llms.txt standard?
No. We support the standard (llmstxt.org) and our generator outputs to spec. But WhoCrawls is independent. We're not a standards body. We're a dashboard.