User-agent: AhrefsBot
User-agent: SemrushBot
User-agent: MJ12bot
User-agent: Screaming Frog SEO Spider
User-agent: Dotbot
User-agent: SEOkicks-Robot
User-agent: BLEXBot
User-agent: Barkrowler
User-agent: SEOkicks
User-agent: Cliqzbot
User-agent: linkdexbot
User-agent: MegaIndex.ru
User-agent: YandexBot
User-agent: Sogou web spider
User-agent: Exabot
User-agent: Rogerbot
User-agent: MegaIndex
User-agent: Xenu Link Sleuth
User-agent: Sistrix
User-agent: SEOlyticsCrawler
User-agent: SiteExplorer
User-agent: LinkpadBot
User-agent: AspiegelBot
User-agent: Bytespider
User-agent: DotBot
User-agent: Zoominfobot
User-agent: CCBot
User-agent: ZumBot
User-agent: SerpstatBot
Disallow: /