# ShipSafe robots.txt # https://ship-safe.co User-agent: Googlebot Allow: / Allow: /pricing Allow: /docs/ Allow: /report/ Disallow: /api/ Disallow: /sso-callback Disallow: /cli/verify Disallow: /dashboard Disallow: /scan Disallow: /settings Disallow: /findings Disallow: /history Disallow: /badges Disallow: /org User-agent: Bingbot Allow: / Allow: /pricing Allow: /docs/ Allow: /report/ Disallow: /api/ Disallow: /sso-callback Disallow: /cli/verify Disallow: /dashboard Disallow: /scan Disallow: /settings Disallow: /findings Disallow: /history Disallow: /badges Disallow: /org User-agent: PerplexityBot Allow: / Allow: /pricing Allow: /docs/ Allow: /report/ Disallow: /api/ Disallow: /sso-callback Disallow: /cli/verify Disallow: /dashboard Disallow: /scan Disallow: /settings Disallow: /findings Disallow: /history Disallow: /badges Disallow: /org User-agent: ChatGPT-User Allow: / Allow: /pricing Allow: /docs/ Allow: /report/ Disallow: /api/ Disallow: /sso-callback Disallow: /cli/verify Disallow: /dashboard Disallow: /scan Disallow: /settings Disallow: /findings Disallow: /history Disallow: /badges Disallow: /org User-agent: ClaudeBot Allow: / Allow: /pricing Allow: /docs/ Allow: /report/ Disallow: /api/ Disallow: /sso-callback Disallow: /cli/verify Disallow: /dashboard Disallow: /scan Disallow: /settings Disallow: /findings Disallow: /history Disallow: /badges Disallow: /org User-agent: anthropic-ai Allow: / Allow: /pricing Allow: /docs/ Allow: /report/ Disallow: /api/ Disallow: /sso-callback Disallow: /cli/verify Disallow: /dashboard Disallow: /scan Disallow: /settings Disallow: /findings Disallow: /history Disallow: /badges Disallow: /org User-agent: GPTBot Allow: / Allow: /pricing Allow: /docs/ Allow: /report/ Disallow: /api/ Disallow: /sso-callback Disallow: /cli/verify Disallow: /dashboard Disallow: /scan Disallow: /settings Disallow: /findings Disallow: /history Disallow: /badges Disallow: /org User-agent: * Allow: / Allow: /pricing Allow: /docs/ Allow: /report/ Disallow: /api/ Disallow: /sso-callback Disallow: /cli/verify Disallow: /dashboard Disallow: /scan Disallow: /settings Disallow: /findings Disallow: /history Disallow: /badges Disallow: /org # CCBot (Common Crawl) and Google-Extended (Gemini training/grounding) were covered # only by the wildcard. The agent-readability spec prefers an explicit allow, and an # explicit rule is also what survives a future tightening of the wildcard. User-agent: CCBot Allow: / User-agent: Google-Extended Allow: / Sitemap: https://ship-safe.co/sitemap.xml # Markdown twin of the sitemap above, for agents that prefer it. Sitemap: https://ship-safe.co/sitemap.md