view docs/assets/robots.txt @ 824:e01473c3ea7e

Allow page source to post-process page config at the end of page loading
author Ben Artin <ben@artins.org>
date Tue, 27 Dec 2016 04:09:38 -0500
parents 26e59f837558
children
line wrap: on
line source

# www.robotstxt.org/

# Allow crawling of all content
User-agent: *
Disallow: