Just wondering if anyone has had a similar problem. Essentially, after creating several new dynamic search ads with various targets (product groups, landing pages, etc.) my site has been bombarded with requests from the Google Crawler, so much so that I thought it was a DDoS attack. I’m not an expert on how crawlers work, so I’m wondering if this will be a one-time problem caused by the initial setup, or do I need to find a long-term solution. Any thoughts?
That’s really weird. I’ve never heard of that. But it would have to be for just as they try to index all your new stuff. Would have to think just for now. They don’t want to waste the crawler budget. In fact I’ve never even thought about asking them to crawl my site less.
Just double confirming this was the google crawler? I’ve only had this kind of thing happen to me once and turned out that was Baidu.