view docs/assets/robots.txt @ 1134:986ecdaa2a36

url: New `url` command to get the URL of a page from its path.
author Ludovic Chabant <ludovic@chabant.com>
date Mon, 23 Apr 2018 21:37:27 -0700
parents 26e59f837558
children
line wrap: on
line source

# www.robotstxt.org/

# Allow crawling of all content
User-agent: *
Disallow: