crawl demand
Also called: crawl need
Crawl demand is how much Google wants to crawl a site or its URLs, driven by their popularity, how stale Google's stored copy has become, and the perceived inventory of URLs it knows about. Together with crawl capacity limit, it makes up a site's crawl budget.
What drives crawl demand
Google names three inputs. Popularity: “URLs that are more popular on the Internet tend to be crawled more often to keep them fresher in our systems.” Staleness: Google’s systems “want to recrawl documents frequently enough to pick up any changes.” Perceived inventory: without guidance, Google tries to crawl every URL it knows about, so duplicates and junk URLs pull demand away from the pages that deserve it.
Demand is only half of the equation. The other half is crawl capacity limit, the ceiling set by how fast and reliably your server responds. A site can have spare capacity and still get crawled lightly if demand is low. Google’s stated way to lift demand is to raise the value and uniqueness of your content, not to trick the crawler.
Crawler type matters too. Per Google, “Googlebot’s demand varies based on a site’s size, update frequency, page quality, and relevance, compared to other sites,” while AdsBot and Google Shopping carry their own separate demand.
Most of your practical control lives in inventory. Consolidate duplicates, block low-value paths in robots.txt, return clean 404/410 for dead URLs, remove soft 404s and redirect chains, and keep an accurate sitemap with lastmod so Google spends its demand where it counts.
How it affects your traffic
Low crawl demand means new and updated pages sit uncrawled, so they never make it into the index and never earn clicks. Large or fast-changing sites feel this first, because there are more URLs competing for the same attention. It also slows how quickly refreshed content and technical fixes reach both classic results and the AI systems that pull from Google's index. A Technical SEO pass trims wasted inventory and improves server response so demand lands on the pages that actually convert.
Get Technical SEO that moves the needle
We turn terms like this into ranked pages and qualified pipeline. Start with a free Initial SEO Strategy.