Mercurial > piecrust2

view docs/assets/robots.txt @ 703:dab26ab3d533

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
internal: Don't run regexes for the 99% case of pages with no segments.
author Ludovic Chabant <ludovic@chabant.com>
date Sat, 16 Apr 2016 23:12:06 -0700
parents 26e59f837558
children
line wrap: on
line source

# www.robotstxt.org/

# Allow crawling of all content
User-agent: *
Disallow: