User-Agent: GoForIt.com Disallow: / User-agent: Baiduspider+ Disallow: / User-agent: Baiduspider+(+http://www.baidu.com/search/spider.htm) Disallow: / User-agent: BaiduImagespider+(+http://help.baidu.jp/system/05.html) Disallow: / User-agent: MJ12bot Disallow: / User-agent: * Disallow: /namachan User-agent: * Disallow: /cgi User-agent: * Disallow: /cgi/and_ik User-agent: Googlebot Disallow: /cgi/and_ik User-agent: Googlebot Disallow: /cgi User-agent: Googlebot Disallow: /namachan User-agent: Slurp Disallow: /cgi User-agent: Y!J-DSC Disallow: /cgi User-agent: Y!J-VSC/ViSe Disallow: /cgi User-agent: Y!J-PSC Disallow: /cgi User-agent: Y!J-NSC/1.0 Disallow: /cgi User-agent: * Disallow: /imge User-agent: * Disallow: /mobile User-agent: * Disallow: /photo User-agent: * Disallow: /tkp User-agent: Googlebot Disallow: /cgi User-agent: ia_archiver Disallow: / User-Agent: Googlebot-Image Disallow: / User-agent: Slurp Disallow: /photo User-agent: Slurp Disallow: /imge User-agent: Slurp Disallow: /cgi User-agent: ::_detectURL Disallow: / User-agent: MVAClient Disallow: / InfoSeek Sidewinder/0.9 Disallow: /photo InfoSeek Sidewinder/0.9 Disallow: /imge InfoSeek Sidewinder/0.9 Disallow: /cgi User-agent: nabot Disallow: /photo User-agent: nabot Disallow: /imge User-agent: nabot Disallow: /cgi User-agent: Openbot Disallow: / User-agent: http://www.almaden.ibm.com/cs/crawler Disallow: / User-agent: searchpreview Disallow: /photo User-agent: searchpreview Disallow: /cgi User-agent: searchpreview Disallow: /imge User-agent: Gaisbot/3.0+(robot@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php) Disallow: / User-Agent: fast Disallow: / User-agent: Openfind data gatherer Disallow: / User-agent: Scooter/3.3 Disallow: / User-agent: buildrack93.sv.av.com Disallow: / User-agent: PlantyNet_WebRobot_V1.9 dhkang@plantynet.com Disallow: / User-agent: kuloko-bot/0.2 Disallow: / User-agent: searchpreview Disallow: / User-agent: NABOT/5.0 Disallow: / User-agent: NaverBot-1.0 Disallow: / User-agent: Cowbot* Disallow: / User-agent: sohu-search Disallow: / User-agent: Cowbot-0.1.1 Disallow: / User-agent: IconSurf Disallow: /favicon.ico