Mercurial > piecrust2

view docs/assets/robots.txt @ 244:ba857c693c72

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
sources: Fix a bug where the `posts` source wasn't correctly parsing URLs. Don't crash when a component is missing from the URL and we have to recapture.
author Ludovic Chabant <ludovic@chabant.com>
date Thu, 19 Feb 2015 19:55:09 -0800
parents 26e59f837558
children
line wrap: on
line source

# www.robotstxt.org/

# Allow crawling of all content
User-agent: *
Disallow: