Mercurial > piecrust2
view docs/assets/robots.txt @ 1134:986ecdaa2a36
url: New `url` command to get the URL of a page from its path.
author | Ludovic Chabant <ludovic@chabant.com> |
---|---|
date | Mon, 23 Apr 2018 21:37:27 -0700 |
parents | 26e59f837558 |
children |
line wrap: on
line source
# www.robotstxt.org/ # Allow crawling of all content User-agent: * Disallow: