# https://www.robotstxt.org/robotstxt.html User-agent: * Allow: / Disallow: /api/ Disallow: /admin/ # Sitemap Sitemap: https://bohohairskin.ch/sitemap.xml # Crawl-delay for aggressive bots User-agent: AhrefsBot Crawl-delay: 10 User-agent: SemrushBot Crawl-delay: 10