Crawl budget

    How many pages a search engine agrees to crawl on your domain.

    What Crawl budget means

    Crawl budget is the number of URLs a search engine is willing to fetch from one domain over a given period. It follows from how quickly the site answers and how often its content genuinely changes. On a small site it constrains nothing. Past a few tens of thousands of URLs it decides which pages get seen and which stay out of the index for months.

    Why it matters in our work

    On a large domain the first thing the technical audit looks at is where the budget goes: parameters, filters, duplicate pages. Reclaiming that share is usually the fastest way to get the pages that matter indexed.

    From the definition to the plan

    Thirty minutes, your site open: what's holding you back and where we'd start. You talk to a founder, and if organic isn't your problem, we say so.

    Oltre AIOltre AI

    Your AI Head of Organic: an entire organic department, at a fraction of the cost.

    Oltre.ai Srl · Viale dell'Industria 10, Sulmona · VAT 02226290662

    © 2026 Oltre.ai Srl

    Cookies

    We use technical cookies to run the site and, only with your consent, analytics cookies to see how it gets used.

    Read the cookie policy
    Menu
    IntegrationsHow it worksPricing