User-agent: * Disallow: /cgi-bin Disallow: /font Disallow: /backup Disallow: /download Host: https://cs-profy.ru Sitemap: https://cs-profy.ru/sitemap.xml User-agent: AhrefsBot Disallow: / User-agent: SemrushBot-SA Disallow: / user-agent: SemrushBot disallow: / #majestic user-agent: MJ12bot disallow: / #moz user-agent: rogerbot disallow: / user-agent: dotbot disallow: / #linkpad user-agent: LinkpadBot disallow: /