Mercurial > piecrust2
view docs/assets/robots.txt @ 482:cce911be024d
serve: Fix a crash when matching taxonomy URLs with incorrect URLs.
This is still around code that should have been fixed a while ago but hey,
consider this a growing TODO.
author | Ludovic Chabant <ludovic@chabant.com> |
---|---|
date | Tue, 21 Jul 2015 22:42:05 -0700 |
parents | 26e59f837558 |
children |
line wrap: on
line source
# www.robotstxt.org/ # Allow crawling of all content User-agent: * Disallow: