Crawl budget for small sites: stop wasting URLs

Keep Google on the pages that earn money. A short technical hygiene list.

Crawl budget for small sites: stop wasting URLs

Quick answer: Noindex thank-you pages, canonicalise slash variants, and keep the sitemap to real 200 URLs.

Keep Google on the pages that earn money. A short technical hygiene list. This guide is written for businesses in the UK and Kent, Surrey and Greater London.

What crawl budget means on a small site

You do not have millions of URLs. You still should not ask Google to recrawl filters, cart parameters or 404 experiments.

Hygiene checklist

One host, HTTPS, one slash style, noindex thanks and admin, sitemap of 200s only.

Scheduled posts

Do not list future posts in the sitemap. Publish them when they are live.

Help

SEO Friendly Website Design fixes this on sites from £150. Request a crawl review.

Frequently asked questions

Do I need a robots disallow for thanks?

Noindex is cleaner than a broad disallow if you still need the page.

Should I sitemap images?

Only if they are unique and useful. Decorative SVGs can skip.

How often should I recrawl?

After meaningful publishes, not daily empty pings.

← Back to all guides
Keep reading

Related guides

Ready for a website that Google loves?

Get a free, no-obligation quote for an SEO friendly website design — built fast, built mobile-first, built to rank.

WhatsApp