IP = 104.20.22.37
robots.txtUser-agent: *
Allow: /
Sitemap: https://trigger.dev/sitemap.xml
Disallow: /v3-early-access
Disallow: /triggerbook
Disallow: /triggerbook/badges
Disallow: /triggerbook/buttons
Disallow: /triggerbook/cards
Disallow: /triggerbook/codeblock
Disallow: /triggerbook/header
Disallow: /triggerbook/nav
Disallow: /triggerbook/paragraph
Disallow: /hacktoberfest
Disallow: /supabase
User-agent: GPTBot
Allow: /
User-agent: ChatGPT-User
Allow: /
User-agent: Claude-Web
Allow: /
User-agent: anthropic-ai
Allow: /
User-agent: PerplexityBot
Allow: /
User-agent: Cohere-ai
Allow: /
Look up this url in the url tool
https://trigger.dev/.well-known/acme-challenge: 404 application/json; charset=utf-8
https://trigger.dev/.well-known/csvm: 404 text/html
https://trigger.dev/.well-known/nostr.json: 404 text/html
https://trigger.dev/.well-known/security.txt: 404 text/html
https://trigger.dev/.well-known/traffic-advice: 404 text/html