Categories
Uncategorized

.htaccess and Robots.txt for blocking bad bots

I am fed up with having huge amount of traffic from bots that serves no purpose whatsoever  These are bots that don’t make sense at all. Its impossible to control these bots using a Robots protocol as they don’t follow them and usually mask their user agent. My site is in English and the content is […]