evil bot

How to block fake Googlebot clients in NGINX

Lately, some of my websites have had some serious leeching issues with clients pretending to be Googlebot. They send the correct user agent string, ‘Googlebot/2.1 (+http://www.googlebot.com/bot.html)’, but they come from IP’s which have not been assigned to Google. This got me thinking… There must be a way to configure NGINX so that it makes sure […]

How to block fake Googlebot clients in NGINX Read More »