view docs/assets/robots.txt @ 581:911a054f4fbd

bake: Add support for a "known" page setting that excludes it from the bake. (this is useful to set pages as "drafts")
author Ludovic Chabant <ludovic@chabant.com>
date Wed, 30 Dec 2015 14:49:44 -0800
parents 26e59f837558
children
line wrap: on
line source

# www.robotstxt.org/

# Allow crawling of all content
User-agent: *
Disallow: