view docs/assets/robots.txt @ 420:596e9ca2da86

rmlists: Add `rmlists` command to invalidate cached page lists.
author Ludovic Chabant <ludovic@chabant.com>
date Thu, 23 Mar 2017 21:59:28 -0700
parents 3a61f45702cb
children
line wrap: on
line source

# www.robotstxt.org/

# Allow crawling of all content
User-agent: *
Disallow: