##ACAP version=1.0 # Conventional policies... User-agent: * Disallow: /sendarticle/ Disallow: /Users/ Disallow: /users/ Disallow: /*/print$ Disallow: /email/ Disallow: /contactus/ Disallow: /share/ Disallow: /websearch Disallow: /*?commentpage= Disallow: /whsmiths/ Disallow: /external/overture/ Disallow: /*?showallcomments=true User-agent: msnbot/2.0bt Disallow: / User-agent: Speedy Spider Disallow: / User-agent: envolk Disallow: / User-agent: psbot Disallow: / User-agent: mmcrawler/Nutch Disallow: / User-agent: Chen Li/Nutch Disallow: / User-agent: MySpace Disallow: / User-agent: sbider21 Disallow: / User-agent: bot3 Disallow: / User-agent: Exabot Disallow: / User-agent: crawl-5c.cuil.com Disallow: / User-agent: panscient Disallow: / User-agent: Yandex Disallow: / User-agent: ScoutJet Disallow: / User-agent: LinkWalker Disallow: / User-agent: BPImageWalker Disallow: / User-agent: SheenBot Disallow: / User-agent: natcrawlbloc03 Disallow: / User-agent: DotBot Disallow: / User-agent: Baiduspider Disallow: / User-agent: Sogou web spider Disallow: / User-agent: Voilabot Disallow: / User-agent: YoudaoBot Disallow: / User-agent: Yahoo! Slurp Disallow: / User-agent: Googlebot-Mobile Crawl-delay: 1 Disallow: /sendarticle/ Disallow: /Users/ Disallow: /*/print$ Disallow: /email/ Disallow: /contactus/ Disallow: /share/ Disallow: /websearch Disallow: /*?commentpage= Disallow: /whsmiths/ Disallow: /external/overture/ Disallow: /*?showallcomments=true # ACAP policies... ACAP-crawler: * ACAP-disallow-crawl: /sendarticle/ ACAP-disallow-crawl: /Users/ ACAP-disallow-crawl: /*/print$ ACAP-disallow-crawl: /email/ ACAP-disallow-crawl: /contactus/ ACAP-disallow-crawl: /share/ ACAP-disallow-crawl: /websearch ACAP-disallow-crawl: /*?commentpage= ACAP-disallow-crawl: /whsmiths/ ACAP-disallow-crawl: /external/overture/ ACAP-disallow-crawl: /*?showallcomments=true