RankCLI-Bot
If you found rankcli.dev/bot in your logs, the requests came from an SEO audit that someone ran on your site with RankCLI. RankCLI is not a crawler: it doesn't discover sites, follow links across the web or build an index. It fetches pages only when an audit asks for them.
When audits happen
- Someone runs a free audit of a URL on rankcli.dev, like any online SEO checker.
- A RankCLI account has the site in its projects: those are audited on a schedule (weekly or daily), on demand, and when the site's repository is pushed to.
- Someone runs the RankCLI command-line tool or MCP server. Those requests come from that person's own machine, not from our servers.
What an audit requests
A one-page audit fetches the page, robots.txt, the sitemap, and the stylesheets, scripts and images the page links to, so it can check them: usually a few dozen requests. A site audit repeats that for up to 10 pages. RankCLI reads your robots.txt to report on it.
User agents
Requests identify themselves with a user agent that starts with RankCLI, for example:
RankCLI-Bot/1.0 (+https://rankcli.dev/bot)RankCLI/1.0 (+https://rankcli.dev)
Audits run from rankcli.dev come from Fly.io's network (US East). Audits run with the command-line tool come from wherever it was run.
Contact
To report a problem or ask us to stop auditing your site, email [email protected] with your domain. You can also block user agents that start with RankCLI at your firewall or CDN.