Faceted Navigation and Crawl Budget
Faceted navigation is the set of filters that let shoppers narrow a list by colour, size, price and so on. It is brilliant for users but a notorious SEO trap, because each filter combination can create a new, crawlable URL.
Left unmanaged, it can generate millions of near-identical pages and waste your crawl budget on noise that will never rank.
What Is Crawl Budget?
Crawl budget is the number of pages a search engine will crawl on your site in a given period. On large sites it is effectively finite, so you want it spent on the pages that matter — not endless filter variations.
How We Tame It
We control which filtered URLs search engines may explore and which they should ignore.
- Decide which valuable filters deserve indexable pages.
- Block low-value combinations from crawling or indexing.
- Use canonical tags to consolidate near-duplicates.
Balancing Users and Crawlers
The aim is never to spoil the shopping experience. Filters stay fully usable for visitors; we simply guide crawlers away from the combinations with no search demand. Done well, customers keep their convenient filtering while Google focuses on the category and product pages you actually want to rank.
Frequently Asked Questions
Should I index every filtered page?
No. Index only the combinations with real search demand, such as a popular brand or category, and control the rest.
If you need a hand with any of this, your Progressive Robot delivery team is ready to help. Raise a ticket from the Support area of your client portal or speak to your account manager and we will guide you through the next steps.