view docs/assets/robots.txt @ 482:cce911be024d

serve: Fix a crash when matching taxonomy URLs with incorrect URLs. This is still around code that should have been fixed a while ago but hey, consider this a growing TODO.
author Ludovic Chabant <ludovic@chabant.com>
date Tue, 21 Jul 2015 22:42:05 -0700
parents 26e59f837558
children
line wrap: on
line source

# www.robotstxt.org/

# Allow crawling of all content
User-agent: *
Disallow: