RankCLI-Bot

If you found rankcli.dev/bot in your logs, the requests came from an SEO audit that someone ran on your site with RankCLI. RankCLI is not a crawler: it doesn't discover sites, follow links across the web or build an index. It fetches pages only when an audit asks for them.

When audits happen

  • Someone runs a free audit of a URL on rankcli.dev, like any online SEO checker.
  • A RankCLI account has the site in its projects: those are audited on a schedule (weekly or daily), on demand, and when the site's repository is pushed to.
  • Someone runs the RankCLI command-line tool or MCP server. Those requests come from that person's own machine, not from our servers.

What an audit requests

A one-page audit fetches the page, robots.txt, the sitemap, and the stylesheets, scripts and images the page links to, so it can check them: usually a few dozen requests. A site audit repeats that for up to 10 pages. RankCLI reads your robots.txt to report on it.

User agents

Requests identify themselves with a user agent that starts with RankCLI, for example:

  • RankCLI-Bot/1.0 (+https://rankcli.dev/bot)
  • RankCLI/1.0 (+https://rankcli.dev)

Audits run from rankcli.dev come from Fly.io's network (US East). Audits run with the command-line tool come from wherever it was run.

Contact

To report a problem or ask us to stop auditing your site, email [email protected] with your domain. You can also block user agents that start with RankCLI at your firewall or CDN.