crawl stats report
Also called: crawl stats, search console crawl stats report, googlebot crawl stats
The Crawl Stats report is a Google Search Console report that shows how Googlebot crawled your site over the past 90 days: total crawl requests, total download size, average server response time, host availability status, and breakdowns by response code, file type, crawl purpose, and Googlebot type.
What it shows
The report lives under Settings in Search Console and is available only for root-level properties (a domain property, or a URL-prefix property at the site root), not for subfolders. Google positions it for advanced users and notes that sites with fewer than a thousand pages rarely need it.
Three trend charts sit at the top: total crawl requests, total download size, and average response time. Below them, host status flags whether Googlebot hit availability problems. Green means no significant issues in the last 90 days, yellow means at least one significant issue occurred more than a week ago (still within the 90-day window), and red means at least one significant issue in the past week, usually a failed robots.txt fetch, a DNS error, or a server timeout.
Requests then break down four ways:
- By response: 200, 301, 404, 5xx, and so on.
- By file type: HTML, images, CSS, JavaScript, PDF, and more.
- By purpose: discovery (URLs never crawled before) versus refresh (recrawls of known pages).
- By Googlebot type: smartphone, desktop, image, page resource load, AdsBot, and others.
Read together, these show where crawl activity actually goes. A rising share of 404s or 5xx errors, a climbing response time, or crawling concentrated on junk URLs all point to wasted crawl budget and slower indexing. Example URLs in the report are a representative sample, not a complete list, so treat them as leads for deeper log analysis.
How it affects your traffic
Googlebot has a finite budget for your site. When the Crawl Stats report shows requests burning on redirect chains, soft 404s, or slow server responses, new and updated pages get discovered and refreshed later, so ranking changes lag behind your publishing. Our Technical SEO service reads this report to cut crawl waste, fix host availability failures, and speed up server response, so more of Googlebot's budget lands on the pages that earn traffic.
Get Technical SEO that moves the needle
We turn terms like this into ranked pages and qualified pipeline. Start with a free Initial SEO Strategy.