User-agent: *
Allow: /

User-Agent: OmniExplorer_Bot
Crawl-delay: 15

User-agent: Python-urllib
Disallow: /