# seoprofiler . com amazonaws.com ip's start 204 - 67 - 174 - 75 etc. User-agent: spbot Disallow: / # dotnetdotcom.org/#info User-agent: dotbot Disallow: / # Lipperhey Spider User-Agent: Mozilla/5.0 (compatible; Lipperhey Spider; http://www.lipperhey.com/) Disallow: / # Yandex Russische zoekmachine User-Agent: Yandex Disallow: / # Yanga WorldSearch Bot User-Agent: Yanga WorldSearch Bot v1.1/beta (http://www.yanga.co.uk/) Disallow: / # plukkie nog natrekken User-agent: plukkie Disallow: / # plukkie nog natrekken User-agent: plukkie Disallow: / # 85.17.211.164 Bot Mozilla/5.0 (compatible; Purebot/1.1; +http://www.puritysearch.net/) leaseweb.com zie mail 090210 User-agent: Bot Mozilla/5.0 (compatible; Purebot/1.1; +http://www.puritysearch.net/) Disallow: / # 85.17.211.164 Bot Browser Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; en) Opera 8.50 leaseweb.com zie mail User-agent: Browser Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; en) Opera 8.50 Disallow: / # 203.6.203.60-79 Catchbot.com Catch=Reed Business Australie http://catch.com.au User-agent: CatchBot Disallow: /