Categories
Uncategorized

.htaccess and Robots.txt for blocking bad bots

I am fed up with having huge amount of traffic from bots that serves no purpose¬†whatsoever¬† These are bots that don’t make sense at all. Its impossible to control these bots using a Robots protocol as they don’t follow them and usually mask their user agent. My site is in English and the content is […]