A Screaming Frog alternative for developers: RankCLI
Screaming Frog SEO Spider is the desktop crawler most SEO teams use: it crawls up to 500 URLs free and millions on a licence, and exports everything for a human to work through. RankCLI is not a feature-for-feature replacement. It is the developer-workflow alternative: the same kind of checks, run from the terminal or CI on every push, with a non-zero exit code and a pull request instead of a spreadsheet.
Facts checked 2026-10-14
12 aspects
| Aspect | RankCLI | Screaming Frog SEO Spider |
|---|---|---|
| What it is | An SEO and AI-search linter for developers: 280+ checks from the CLI, a GitHub Action and an MCP server, with fixes as pull requests. | "A website crawler that audits your site for over 300 SEO issues to help improve both SEO, and UX."[1] |
| Licence and source | Free npm packages under MIT (@rankcli/cli, @rankcli/agent-runtime, @rankcli/mcp-server). The GitHub Action and MCP server repositories are public; the CLI source is not yet published as a repository. | Proprietary desktop software for Windows, macOS, Ubuntu and Fedora; no source repository. Current version 24.3.[2] |
| Price | CLI, Action, MCP server and local fixes are free with no account. Hosted: Free (1 site, weekly), Solo $9/mo, Pro $29/mo ($19 founding for the first 100), Agency $99/mo; every plan runs all 280+ checks. | Free up to 500 URLs per crawl, no sign-up. Licence £199 per user per year (bulk from £169) adds configuration, saved crawls, JavaScript rendering, custom extraction, Google Analytics, Search Console and PageSpeed Insights integrations, and scheduling.[2] |
| Install and run | npx @rankcli/cli audit --url https://your-site.dev. Action integrallis/rankcli-action@v1 (public repository; Marketplace listing pending). MCP: npx @rankcli/mcp-server, 15 tools. Agent skills: npx skills add integrallis/rankcli-mcp-server. Hosted dashboard at rankcli.dev. | Desktop installer. Command line and headless mode: ScreamingFrogSEOSpiderCli.exe or screamingfrogseospider --crawl URL --headless --export-tabs ... with a saved config. An MCP server since v24.0 for Claude, LM Studio and other assistants. No GitHub Action or hosted dashboard; Looker Studio export for reporting.[3] |
| What it audits | 280+ checks: crawlability, indexability, on-page, content, links, Core Web Vitals heuristics, security headers, structured data, local SEO, social, accessibility, AI readiness. Multi-page crawl, --max-pages N (default 5). | Over 300 issues across response codes, security, URLs, titles, descriptions, headings, content, images, canonicals, pagination, directives, hreflang, JavaScript, links, AMP, structured data, sitemaps, PageSpeed (via the PageSpeed Insights API), mobile, accessibility (WCAG via axe), analytics, Search Console and validation. Crawls up to 500 URLs free, effectively unlimited on a licence within memory and storage.[5] |
| AI search (GEO) checks | AI crawler access tested by fetching as each crawler and comparing with a browser (catches CDN-level blocks robots.txt cannot show), llms.txt, citation-worthiness, answer structure, E-E-A-T, RAG chunk readiness, entity and brand checks. | Can crawl as Googlebot, Bingbot, AI crawlers or a custom user agent. We found no llms.txt or AI-crawler-access audit on the official site as of 2026-10-14.[1] |
| CI gating | --fail-on error|warning|notice and --min-score N; exit 0 pass, 1 gate failed, 2 bad invocation, 3 site unreachable, so a down site never passes. The Action posts a PR comment and can alert Slack or Discord. README badge on the hosted Free plan. No SARIF output. | None stated: the CLI exports tabs and reports; no threshold exit codes, PR comments, SARIF or badges are documented.[3] |
| Fixes | rankcli fix applies fixes locally (--dry-run, --only CODES), free. Hosted auto-fix pull requests through the RankCLI GitHub App: 3 a month on Free, unlimited on paid plans, with per-site open-PR limits. | Reports for humans: bulk export the errors and source URLs to fix, or send to a developer. No fix application or pull requests stated.[1] |
| Monitoring and history | Hosted: scheduled audits (weekly on Free, daily and on every push on Pro), history, weekly email report, Slack and Discord alerts on Solo and up. Search Console sync is built but not yet enabled. | Scheduled crawls in the app (licence feature), headless when scheduled; saved crawls and crawl comparison; v24 added auto-compare and crawl-change email notifications. Search Console integration on a licence. Slack and Discord not stated.[4] |
| AI model use | The checks are deterministic and need no model. Optional AI analysis runs on your model only: Apple Intelligence on-device on a Mac that has it, else Ollama or LM Studio, else your own OpenRouter, OpenAI, Anthropic, Groq, Gemini or DeepSeek key. Nothing goes through RankCLI. | Custom AI prompts with OpenAI, Gemini, Ollama and Anthropic on your own accounts; token usage shown per provider; MCP server for chat assistants.[4] |
| Frameworks | Detects 32 frameworks (94% on a 51-site corpus); fix recipes for 11; build-time plugins astro-rankcli, vite-plugin-rankcli and next-rankcli; framework guides at /seo. | None stated. JavaScript rendering with headless Chromium on a licence.[1] |
| Limits worth knowing | No headless browser: pages are audited as served, which is what crawlers see first, so client-rendered content is reported as such rather than rendered. Performance is heuristic, not Lighthouse lab metrics. First public release in 2026. | Per-user licences. The vendor asks you to run the UI once before the command line (EULA, licence key and storage are set there); headless JavaScript rendering on Linux needs a display. Crawl size is bounded by memory and storage.[3] |
Pick Screaming Frog SEO Spider when
- •You are an SEO working through a large site by hand and want every URL, tab and export in a desktop app.
- •You need crawls far beyond a few hundred pages, rendered with headless Chromium, on your own machine.
- •You want Google Analytics, Search Console and PageSpeed data joined to the crawl in one table.
Pick RankCLI when
- •You want the audit to run on every push and fail the build, not on the day someone remembers to crawl.
- •You want the fix as a pull request, or applied locally, instead of an export someone has to turn into tickets.
- •You want AI-search checks, including whether AI crawlers are blocked at the CDN, which we did not find in Screaming Frog.
- •You want it free, scriptable with npx, and usable by Claude Code or Cursor through MCP.
See the RankCLI side for yourself, free and without an account:
npx @rankcli/cli audit -u https://your-site.devSources
Every Screaming Frog SEO Spider fact above was read from these pages on 2026-10-14. If something has changed since, tell us and we will correct it.