comparison docs/assets/robots.txt @ 243:26e59f837558

docs: Add embryo of a documentation website.
author Ludovic Chabant <ludovic@chabant.com>
date Thu, 19 Feb 2015 08:09:17 -0800
parents
children
comparison
equal deleted inserted replaced
242:f130365568ff 243:26e59f837558
1 # www.robotstxt.org/
2
3 # Allow crawling of all content
4 User-agent: *
5 Disallow:
6