# named bots must be listed before general exclusions # as they exit after the 1st applicable statement User-agent: LinkWalker Disallow: / User-agent: psbot Disallow: / User-agent: Googlebot-Image Disallow: /images User-agent: SBIder Disallow: / User-agent: DTAAgent Disallow: / # all bots User-agent: * Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /css/ Disallow: /images/ Disallow: /js/ Disallow: /a40dc/css/ Disallow: /a40dc/images/ Disallow: /a40dc/js/ Disallow: /lans/css/ Disallow: /lans/images/ Disallow: /lans/js/ Disallow: /security/css/ Disallow: /security/images/ Disallow: /security/js/ Disallow: /admin/ Disallow: /*.exe$