1. Home
  2. >
  3. Tools
  4. >
  5. Screaming Frog
Screaming Frog logo

Screaming Frog

Comprehensive SEO audits with real-time crawling

Screaming Frog featured image

August 27, 2024 at 6:22:50 AM

What is Screaming Frog?

The Screaming Frog SEO Spider is an industry-leading website crawler designed for Windows, macOS, and Linux. Trusted by thousands of SEOs and agencies worldwide, this powerful tool helps in conducting comprehensive technical SEO site audits. It efficiently crawls both small and large websites, gathering key onsite data to enable informed SEO decisions.

Features

The Screaming Frog SEO Spider offers a robust set of features to streamline your SEO auditing process:

  • Find Broken Links: Instantly identify broken links (404s) and server errors.
  • Audit Redirects: Detect temporary and permanent redirects, and identify redirect chains and loops.
  • Analyse Page Titles & Meta Data: Evaluate page titles and meta descriptions to find those that are too long, short, missing, or duplicated.
  • Discover Duplicate Content: Use md5 algorithmic checks to find exact and partially duplicated content.
  • Extract Data with XPath: Collect data from HTML using CSS Path, XPath, or regex.
  • Review Robots & Directives: View URLs blocked by robots.txt, meta robots, or X-Robots-Tag directives.
  • Generate XML Sitemaps: Create XML and Image XML Sitemaps with advanced configuration options.
  • Integrate with GA, GSC & PSI: Connect to Google Analytics, Search Console, and PageSpeed Insights APIs for enhanced insights.
  • Crawl JavaScript Websites: Render web pages using the integrated Chromium WRS.
  • Visualise Site Architecture: Use interactive diagrams and tree graphs to evaluate internal linking and URL structure.
  • Schedule Audits: Automate crawls and export data to any location, including Google Sheets.
  • Compare Crawls & Staging: Track changes and compare staging against production environments.

Use Cases

The Screaming Frog SEO Spider is versatile and can be used in various scenarios:

  • Technical SEO Audits: Identify and fix SEO issues like broken links, duplicate content, and missing meta data.
  • Site Migrations: Audit redirects and ensure smooth transitions during site migrations.
  • Content Audits: Extract and analyze key onsite elements to inform content strategy.
  • JavaScript Rendering: Crawl dynamic websites built with frameworks like Angular, React, and Vue.js.
  • Performance Monitoring: Integrate with Google Analytics and PageSpeed Insights to monitor user and performance data.
  • SEO Reporting: Export crawl data to spreadsheets for detailed SEO reporting and recommendations.

Pricing

The Screaming Frog SEO Spider offers both free and paid versions:

Plan Price Features
Free Version Free Crawl up to 500 URLs, basic features
Paid Version £199 per year Unlimited URLs*, advanced features including JavaScript rendering, custom extraction, and more

* The maximum number of URLs you can crawl is dependent on allocated memory and storage.

The paid version provides comprehensive access to all features, making it an invaluable tool for any SEO professional.

FAQs

Alternatives

Featured
Marketing Auditor logo

Marketing Auditor

Verified Tool

Verified Tool

Marketing Auditor is a Verified Tool. Want to get this badge? Contact us.

Verified Tool

Automated audits for Google Ads and Analytics.

Ahrefs logo

Ahrefs

SEO tools to boost traffic and rank higher

SEO
Open in new tab
Lighthouse logo

Lighthouse

Automated insights for web performance and SEO

SEO
Open in new tab
Surfer SEO logo

Surfer SEO

SEO content creation and optimization made easy

SEO
Open in new tab
Sitebulb logo

Sitebulb

Efficient website crawler for better SEO audits

SEO
Open in new tab
Screpy logo

Screpy

AI-Powered SEO and Web Analysis Simplified

SEO
Open in new tab
Blogify logo

Blogify

Convert multimedia to SEO-optimized blogs fast

SEO
Open in new tab
Answer the Public logo

Answer the Public

Unlock Consumer Insights for Content Creation

SEO
Open in new tab
SEO Writing AI logo

SEO Writing AI

AI-powered SEO content in 1 click

SEO
Open in new tab
SEO Stuff logo

SEO Stuff

Affordable SEO tools without monthly fees

SEO
Open in new tab
Yext logo

Yext

AI-enhanced digital presence for multi-location brands

SEO
Open in new tab
GTmetrix logo

GTmetrix

Analyze and optimize your website performance

SEO
Open in new tab