IP = 108.139.10.42
robots.txtSitemap: https://docs.confluent.io/home/sitemap.xml
User-agent: *
Disallow: staging-docs.confluent.io/
Disallow: /?utm*
Disallow: /*session_ref=
Disallow: /ja-jp*
Disallow: /legacy*
User-agent: PerplexityBot
Allow: /
User-agent: GPTBot
Allow: /
User-agent: ClaudeBot
Allow: /
Look up this url in the url tool
https://docs.confluent.io/.well-known/acme-challenge: 200 text/html
https://docs.confluent.io/.well-known/csvm: 200 text/html
https://docs.confluent.io/.well-known/nostr.json: 200 text/html
https://docs.confluent.io/.well-known/security.txt: 200 text/html
https://docs.confluent.io/.well-known/traffic-advice: 200 text/html