# ====================================== # Guarate Solutions - robots.txt # ====================================== # Allow all legitimate bots User-agent: * Allow: / Sitemap: https://www.guaratesolutions.com/sitemap.xml # Block sensitive directories Disallow: /api/ Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /private/ Disallow: /_backup/ Disallow: /admin/ # Block backup file types only Disallow: /*.bak$ Disallow: /*.backup$ Disallow: /*_backup.* # Optional: prevent OpenAI’s GPTBot from using your content for training # This does NOT block ChatGPT’s search bot (OAI‑SearchBot) User-agent: GPTBot Disallow: / # Sitemap location Sitemap: https://www.guaratesolutions.com/sitemap.xml