Since September our company websites are religiously being hit by huge amounts of bot traffic which is rendering out traffic data pretty much useless. We’ve managed to get the server logs and identified IPs that have been hitting the site in huge numbers and filtered out that traffic from our analytics using regex. Despite it working on one of our sites, the others are still being hit by vast amounts of bots. Has anyone else had a similar issue and found a fix that worked other than the one I’ve already tried? Any help would be fantastic!
Note:- the ‘bot’ traffic is all direct, from the US with location as (not set)
Filter host names, not just ips. There are websites out there that keep track of the big ones for this very purpose. Just Google some of the host names producing lots of the bot traffic and they should come up