User-agent: WebZip/4.0 Disallow: / User-agent: AITCSRobot/1.1 Disallow: / User-agent: libWeb/clsHTTP Disallow: / User-agent: HappyBot (gserver.kw.net) Disallow: / User-agent: EnigmaBot Disallow: / User-agent: BlowFish/1.0 Disallow: / User-agent: turingos Disallow: / User-agent: TITAN/0.1 Disallow: / User-agent: JCrawler/0.2 Disallow: / User-agent: ProWebWalker Disallow: / User-agent: WebCopy/ Disallow: / User-agent: Mister PiX Disallow: / User-agent: Mozilla/3.0 (compatible;miner;mailto:miner@miner.com.br) Disallow: / User-agent: Ahoy! The Homepage Finder Disallow: / User-agent: Robbie/0.1 Disallow: / User-agent: EIT-Link-Verifier-Robot/0.2 Disallow: / User-agent: OGspider Disallow: / User-agent: IncyWincy/1.0b1 Disallow: / User-agent: MediaFox/x.y Disallow: / User-agent: TheNomad Disallow: / User-agent: heraSpider Disallow: / User-agent: Open Text Site Crawler V1.0 Disallow: / User-agent: True_Robot Disallow: / User-agent: NEC-MeshExplorer Disallow: /