User-agent: Slurp
Allow: /
Crawl-delay: 30

User-Agent: DISCo Pump, Wget, WebZIP, Teleport Pro, WebSnake, Offline Explorer, Web-By-Mail
Disallow: /

User-agent: Yandex
Allow: /
Disallow: /redirector.php

User-agent: *
Disallow: