The number of pages search engine bots will crawl on your site within a given timeframe. Important for large websites.
Crawl budget is the number of pages a search engine bot is willing and able to crawl on your site within a given timeframe. For small sites (< 1,000 pages), this rarely matters. For large sites (100k+ pages), it is critical.
robots.txt to block low-value parameters.Browse related definitions in the same glossary category.
Algorithm
A complex system used by search engines to retrieve data and deliver results for a query. Google uses multiple algorithms to rank websites.
Algorithm Update
Changes made to a search engine's ranking algorithms that can impact website visibility and traffic.
AMP (Accelerated Mobile Pages)
A framework that enables ultra-fast loading of mobile pages by simplifying HTML and limiting scripts.
API Quotas
Hard limits on total API usage over a billing period, often tied to pricing tiers.
API Rate Limits
Restrictions on how many API requests can be made within a time period, requiring throttling and retry logic.
Broken Link
A hyperlink that no longer works because the destination page has been deleted or moved. Damages UX and SEO value.
Understanding "Crawl Budget" is just the first step. Our team at TwoSquares specializes in technical SEO and digital strategy, helping brands turn complex concepts into measurable growth.