Mercurial > piecrust2
view docs/assets/robots.txt @ 836:dca51cd8147a
Merge pull request #42 from GitHub.
Also cleanup the code a bit.
author | Ludovic Chabant <ludovic@chabant.com> |
---|---|
date | Sun, 05 Feb 2017 22:50:12 -0800 |
parents | 26e59f837558 |
children |
line wrap: on
line source
# www.robotstxt.org/ # Allow crawling of all content User-agent: * Disallow: