Crawl budget

    How many pages a search engine agrees to crawl on your domain.

    What Crawl budget means

    Crawl budget is the number of URLs a search engine is willing to fetch from one domain over a given period. It follows from how quickly the site answers and how often its content genuinely changes. On a small site it constrains nothing. Past a few tens of thousands of URLs it decides which pages get seen and which stay out of the index for months.

    Why it matters in our work

    On a large domain the first thing the technical audit looks at is where the budget goes: parameters, filters, duplicate pages. Reclaiming that share is usually the fastest way to get the pages that matter indexed.

    From the definition to the plan

    Thirty minutes, your site open: what's holding you back and where we'd start. You talk to a founder, and if organic isn't your problem, we say so.

    Oltre AIOltre AI

    Your AI Head of Organic: an entire organic department, at a fraction of the cost.

    Oltre.ai Srl · Viale dell'Industria 10, Sulmona · VAT 02226290662

    © 2026 Oltre.ai Srl

    Menu
    IntegrationsHow it worksPricing