User-agent: AhrefsBot
User-agent: Yandex
User-agent: YaDirectFetcher
User-agent: Baiduspider
Disallow: /

User-Agent: *
Crawl-delay: 2
Allow: *