User-agent: * Disallow: / # Block AI crawlers on staging/noindex site User-agent: GPTBot Disallow: / User-agent: ChatGPT-User Disallow: /