Site Audits & Crawlers – SEO Resources – Free Tools & Guides

About Site Audits & Crawlers

Crawl your site for technical issues: indexation, duplication, canonicals, status codes, internal links.

Row Types:

Special Indicators:

Crawl mobile‑first, respect robots, and render JavaScript where needed.
Export issues and map to owners for fix sprints.
Compare crawls before/after deployments.

Favorites

No favorites yet. Tap ☆ on any game.

Site Audits & Crawlers

Screaming Frog SEO Spider — Gold‑standard desktop crawler
Sitebulb — Audits with graphs & Hints
Lumar (Deepcrawl) — Enterprise cloud crawling
Botify — Enterprise SEO platform
JetOctopus — Log + crawl analysis
OnCrawl — Data‑driven cloud crawler
Siteliner — Duplicate content checker
Netpeak Spider — Affordable desktop crawler
ContentKing (Conductor) — Real‑time monitoring
SEOlyzer — Free log analyzer
Headless Chrome + Lighthouse CI — Automated audits
Ahrefs Site Audit — Cloud audits
Semrush Site Audit — Issues & themes
Beam Us Up — Legacy desktop crawler