Spambots and spiders that ignore robots exclusion file can kill your site both in bandwidth and by potentially exposing information you don't want 'harvested.' With that in mind, here is a quick-n-dirty guide to blocking spambots and rogue search engine spiders by using .htaccess. First the essential example codeblock, followed by a working example: Continue reading
Trending Articles
More Pages to Explore .....