
Screaming Frog
Audit websites with SEO Spider and extend crawls with extraction and AI prompts.
Free crawl allowance
500 URLs per crawl
Advanced configuration, saving crawls, rendering, extraction, and API integrations are restricted.
Pricing
Free up to 500 URLs per crawl. Paid licences cost £199 per user/year for purchases of 1–4 licences.
- Crawl a site to locate broken links, redirect problems, and duplicate content, then export findings for repair.
- Extract page data with selectors or run custom prompts through connected AI providers. External model services can carry separate charges.
- Keep in mind: The free edition is limited to 500 URLs per crawl and restricts saving, custom extraction, JavaScript rendering, and API integrations.
- Works with: Ollama
What is Screaming Frog?
Screaming Frog develops SEO Spider, a desktop website crawler for technical SEO audits on Windows, macOS, and Linux. It identifies broken links, redirect problems, and duplicate content, with exports to help teams investigate and fix issues. Licensed features add custom data extraction and optional AI prompts against crawl data.
Find and investigate technical SEO issues
- Broken-link auditing finds 404s and server errors and exports the affected URLs and their source pages.
- Redirect auditing exposes chains, loops, and temporary or permanent redirects for investigation.
- Duplicate-content checks locate exact duplicate URLs, repeated metadata or headings, and low-content pages.
Extend licensed crawls with extraction and AI
- Custom HTML extraction collects page fields such as prices, SKUs, or headings with CSS Path, XPath, or regular expressions.
- AI prompts on crawl data apply preset or custom prompts to page elements for tasks such as language or intent analysis.
- Local-model integration connects Ollama so a local LLM can participate in the crawl-analysis workflow.
Integrations
User reviews
No reviews yet. Be the first to review this tool.
Log in to write a review.
Details on this page are for reference only and may be out of date or inaccurate. Check Screaming Frog's official website for current features and pricing.
Join the Aivolut newsletter
Occasional practical AI tips, app updates, and offers. Unsubscribe anytime.