User-agent: Gigabot Disallow: / User-agent: NaverBot Disallow: / User-agent: TurnitinBot Disallow: / User-agent: FAST-WebCrawler Disallow: / User-agent: Mercator Disallow: / User-agent: NPBot Disallow: / User-agent: ZyBorg Disallow: / User-agent: Slurp Disallow: / User-agent: RoboCrawl Disallow: / User-agent: OmniExplorer Disallow: / # Why is your bot excluded? # See http://www.perldesignpatterns.com/robots.txt # I'm just mirroring this content during a transition. # I don't want to become its new official location. User-agent: * Disallow: /a