# https://www.robotstxt.org/robotstxt.html User-agent: * Allow: / # Sitemaps Sitemap: https://linkclass.hk/sitemap.xml # Crawl-delay for smaller bots to prevent server load User-agent: dotbot Crawl-delay: 10 User-agent: AhrefsBot Crawl-delay: 10