Ask HN: How long did Google take to index your large catalogue site?
I have a static site with about 18,700 pages. Each page is about one item in a large catalogue, and they're all generated from the same data by a script.
Google has indexed around 3,000 of them and is fetching about 38 pages a day, so at this rate the rest will take over a year. Most of the others sit under "Discovered, currently not indexed" in Search Console.
What I've checked: every page returns 200, the pages are fast, the sitemap is split and has change dates, canonicals are in place, and two site audits found nothing technical to fix. The pages Google does crawl mostly get indexed.
The site is about four months old and has very few links from other sites, which I assume is most of the problem. A similar site that started around the same time has far more pages indexed.
Is this just a matter of waiting and getting links, or is there something practical that makes Google crawl a new site faster? I'd be grateful for anything that has worked for you.
No comments yet.