view docs/assets/robots.txt @ 401:8e1e55ad35fb

linker: Fix error when trying to list non-existing children. Add unit tests.
author Ludovic Chabant <ludovic@chabant.com>
date Mon, 18 May 2015 23:32:43 -0700
parents 26e59f837558
children
line wrap: on
line source

# www.robotstxt.org/

# Allow crawling of all content
User-agent: *
Disallow: