User-agent: * Disallow: /login Disallow: /*login Disallow: /register Disallow: /*register Disallow: /redirect Disallow: /*redirect Disallow: /blackhole Disallow: /*blackhole Crawl-delay: 10 Request-rate: 1/10