Audit a whole website for SEO, free
Enter your website and the crawler visits page after page, reading titles, meta descriptions, headings and errors as it goes. Get one clean Excel file with every page and every heading.
- Free, no sign-up
- Reads public pages only
- Excel and CSV download
Up to 500 pages · Excel with Pages, Headings, Issues and Broken links
How to use the Website SEO Crawler
- Enter the websiteType the home page address, or a folder such as example.com/blog/ to check only that section.
- Choose how many pagesPick 50, 100, 200 or 500 pages, and whether to find pages by following links, from the sitemap, or both.
- Watch it crawlPages appear in the table as they are checked. Click any row to see its issues and its full H1 to H6 outline. You can stop at any time and keep the results.
- Download the Excel reportGet Summary, Pages, Headings H1-H6, Issues and Broken links sheets, or a CSV of the pages table.
Why use this website seo crawler
Checking pages one by one is slow. A crawler does it the way search engines do: it starts at one page, follows the links and reads each page it finds. In a few minutes you get a full picture of titles, descriptions and headings across the site, plus the errors that are easy to miss.
The crawl runs from your browser and asks our reader for one page at a time, so it is gentle on your server. Large sites can be checked section by section using the folder option.
- All headings of all pagesA Headings sheet lists every H1 to H6 with its page, in order.
- Issues found for youMissing or long titles, missing descriptions, missing or multiple H1s, noindex, thin pages and slow pages.
- Duplicates and broken linksPages sharing the same title or description, and pages that return errors with the pages that link to them.
- Polite crawlingTwo pages at a time, robots.txt respected, and you can stop whenever you like.
- FiltersShow only pages with issues, errors or one kind of problem.
Questions people ask
How many pages can it crawl?
Up to 500 pages in one run. For larger sites, crawl one section at a time, for example /blog/, using the “Only pages inside the link’s folder” option.
Does it follow robots.txt?
Yes. Pages that robots.txt asks tools not to read are skipped and marked in the report.
Why are some pages missing?
The crawler only finds pages that are linked from other pages or listed in the sitemap. Pages behind logins, forms or search boxes cannot be reached.
What is in the Excel file?
A Summary with issue counts, a Pages sheet with status, title, description, H1, heading counts, words and issues for each page, a Headings sheet with every H1 to H6, an Issues sheet and a Broken links sheet.
Will crawling slow down my website?
It reads two pages at a time, which is lighter than a normal visitor browsing quickly.
More free tools
All 26 tools- SEO Page AnalyzerTitle, meta, H1 to H6, keywords and a score
- Indexability and Sitemap CheckerWhich pages Google may index, and why not
- Website Keyword FinderFind every page that mentions a word
- Website Technology DetectorWordPress, PHP, React, CDN and more
- Background RemoverCut out people and portraits in one click
- AI Photo EnhancerUpscale photos, logos and text 2× or 4×
From the H View blog
H View SEO tools read public web pages the way a search engine does, through a small reader on hview.in, and follow each site’s robots.txt. Reports are made in your browser and are not stored. Results show what the page says about itself; only Google Search Console shows how Google actually treats your site. Use them on sites you own or have permission to check.
Our best stories, in your inbox.
The week’s best Her View, His Insight reading in one short, useful note.
Free. We only use your email to send The H View Brief. Unsubscribe any time.