User-agent: Slurp Crawl-delay: 20 Disallow: /mail.asp Disallow: /rss/cat/ User-agent: * Disallow: /mail.asp Disallow: /rss/cat/