-
Crawl Stats – GSC
Just read a great article on utilizing the crawl stats report in search console. I’m discovering I’ve got a lot of URLs not currently indexed. It’s a large site and looking at the Purpose report, only 4% are discovery URLs. Anyone have a clue about optimizing crawl budget to get these URLs crawled more quickly?
-
5 Replies
-
Biggest correlation I’ve noticed is
1) link structure. SERPs are much more likely to crawl discovered pages if they have important links (ie from homepage or nearby)
2) make your TTFB blazing fast
3) reduce overall page load. Nowadays google actually renders the pages, thus reducing your budget
4) ranking higher in general will give you higher SERPs crawl budget -
Sitemaps are also helpful
-
Crawl budget isn’t an issue unless you have 10k+ pages. There is no strictly defined number though. You’ll find sites with 100k+ pages that dont deplete their crawl budget.
For faster indexing try:
1) keep sitemaps updated
2) add internal links from older posts to newer ones
3) try to get some backlinks
4) share new page links via social media
5) and a lot more you can do, but this should be enuff to move the needle. -
Could you link the article?
-
Discovery =! Indexed
Log in to reply.