# robots.txt for http://www.w-ecker.de User-agent: * Disallow: /DEVELOPMENT/ Disallow: /DOWNLOAD/ Disallow: /INCLUDES/ Disallow: /TEST/ User-agent: psbot User-agent: wget User-agent: webzip User-agent: webmirror User-agent: webcopy User-agent: asterias User-agent: asterias/2.0 User-agent: Ask Jeeves/Teoma User-agent: Yahoo! Slurp User-agent: Asterias Crawler User-agent: SpiderThread Disallow: /