Webmasterworld Shuts Out The Search Engines
Wednesday, November 23rd, 2005 I noticed a very interesting thread on one of my favourite sites, Brett Tabke’s Webmasterworld, in which he has decided to completely ban all search engine robots from the site with a robots.txt file.
This means no pages from Webmasterworld will be findable in Yahoo, Google, MSN or any other legitimate search engine. The main problem […]