SEO and GEO · 2026-10-20

Crawl budget: which URL Google fetches first on a company site

Y.Emre Konar · crawl budget on a company website

Crawl budget is which address the bot spends its fetches on. The enquiry page should not wait behind filters and copies.

Google does not fetch every URL on a company site at the same rate. Crawl budget is the set of fetches the bot will spend in a period. Faceted filters, session IDs, empty tags and copies of the same list spend that set. The service URL where a buyer would enquire ends up at the back of the queue.

Budget is not a page count

A site with a thousand URLs is not more visible than a site with a hundred. The bot follows status codes, duplicates and the addresses your internal links point at. When a board asks for more pages, the queue often gets longer. The record a buyer asked for does not move forward.

Which URL class goes first

The class that should be fetched first is narrow: a service page that answers one commercial question, a product record that can take an enquiry, and the office and contact pages. The class that should wait is also narrow: sort parameters, internal search results, session URLs, tag pages that repeat the same text. In discovery, HED Creative writes those classes. There is no line that says to crawl the whole site.

What the console and the log show

Search Console crawl stats and, where you grant access, the server log show which class consumed the fetches. The figures are not invented. If the property is yours, the data is yours. Without access, the decision starts from the quality of the URL list. A made-up crawl percentage does not enter the report.

The decision is not a position

Moving fetches onto enquiry URLs does not buy a ranking. Google fetching a URL and a buyer choosing it are separate jobs. The second depends on the answer on the page and on the intent map. It cannot be read until the first has happened.

Discovery needs a URL list or a sitemap, the names of pages that take enquiries, and crawl stats if you have them. Without access, the list is enough to start. No ratio is invented.

A written view of which class comes first sits in the SEO agency scope. If the URL structure itself has to be rebuilt, website development belongs in the same brief. Related decision: index coverage.

Questions companies ask

Is crawl budget one fetch per page?

No. The bot spends a limited set of fetches in a period. Filters and copies consume that set, and the enquiry page waits.

Does adding pages increase visibility?

A page that answers no commercial question lengthens the queue. The class that goes first is written down before anyone adds URLs.

Do we need server logs?

No. A decision can start from the URL list. Crawl stats are added when you grant access. Percentages are not invented.

Is this a ranking guarantee?

No. A fetch and a buyer choosing the page are separate jobs. Position is not written into the scope.

What happens to faceted filters?

If they answer no commercial question, they stay out of the index or point at the canonical URL. The decision is a list, not a slogan.

SEO agencyWhatsApp

Written scope

Pages, timing and fee are written down.

A process you can follow

Each step has an outcome you can check at the next conversation.

TR/DE/EN market language

Buyers in Turkey, Germany and international markets are addressed in their own language.

Contact

Let’s define your project together.

Book a discovery call from our Berlin or Ankara office. A short brief, then a clear roadmap.

Berlin Office

Mitte, Berlin, Germany

+49 176 700 91611
hello@hedcreative.com

European market and premium project management

Ankara Office

Çankaya, Ankara, Türkiye

+90 538 324 92 32
hello@hedcreative.com

Production, shooting organization and content team

A reply within 2 business days

01
02
03
04
05
06
07
08
09
10
11

By submitting this form we process your details to respond to your enquiry. See our Privacy Policy.

WhatsApp+49 176 700 91611
Start a project conversationWhatsApp