# Termly scanner User-agent: TermlyBot Allow: / User-agent: AhrefsBot ​Crawl-Delay: 10 User-agent: * Disallow: /Admin/