User-agent:Googlebot/2.X (+http://www.googlebot.com/bot.html) Disallow: User-agent:CoolBot Disallow: User-agent:Internet Cruiser Robot/2.1 Disallow: User-agent:CydralSpider/X.X (Cydral Web Image Search; http://www.cydral.com/) Disallow: User-agent:Digger/1.0 JDK/1.3.0 Disallow: User-agent:InfoSeek Robot 1.0 Disallow: User-agent:Infoseek Sidewinder Disallow: User-agent:ESISmartSpider/2.0 Disallow: User-agent:Lycos/x.x Disallow: User-agent:marvin/infoseek (marvin-team@webseek.de) Disallow: User-agent:MSNBOT/0.1 (http://search.msn.com/msnbot.htm) Disallow: User-agent:psbot/0.X (+http://www.picsearch.com/bot.html) Disallow: User-agent:whatUseek_winona/3.0 Disallow: User-agent:Mozilla/2.0 (compatible; Ask Jeeves/Teoma) Disallow: User-agent:JavaBee Disallow: User-agent:Slurp/2.0 Disallow: User-agent:UCSD-Crawler Disallow: User-agent:WebCatcher/1.0 Disallow: User-agent:URL Spider Pro Disallow: User-agent:RoboCrawl (http://www.canadiancontent.net) Disallow: User-agent:AgentName/0.1 submitter Disallow: User-agent: Mediapartners-Google* Disallow: User-agent: GoogleBot-Image Disallow: User-agent: AdsBot-Google Disallow: User-agent: * Disallow:/tmp/ Disallow:/logs/ Disallow:/My private files/ Disallow:/stats/ Disallow:/cgi-bin/