IP = 216.150.16.193
robots.txtUser-Agent: *
Allow: /
Disallow: /api/
Disallow: /admin/
Disallow: /library/
Disallow: /editor/
Disallow: /scratch/
Disallow: /onboarding/
Disallow: /profile/
Disallow: /chat/
Disallow: /login/
Disallow: /register/
Disallow: /forgot-password/
Disallow: /reset-password/
Disallow: /verify-email/
Disallow: /education/login
Disallow: /education/home
Disallow: /education/classrooms/
Disallow: /education/join/
Disallow: /classroom/
Disallow: /editor-v2/
Disallow: /project/
Disallow: /article/
User-Agent: GPTBot
Allow: /
Allow: /publish/
Allow: /worlds
Allow: /about
Allow: /how-it-works
Disallow: /api/
Disallow: /admin/
Disallow: /library/
Disallow: /editor/
User-Agent: ChatGPT-User
Allow: /
Allow: /publish/
Allow: /worlds
Allow: /about
Allow: /how-it-works
Disallow: /api/
Disallow: /admin/
Disallow: /library/
Disallow: /editor/
User-Agent: PerplexityBot
Allow: /
Allow: /publish/
Allow: /worlds
Allow: /about
Allow: /how-it-works
Disallow: /api/
Disallow: /admin/
Disallow: /library/
Disallow: /editor/
User-Agent: Claude-Web
Allow: /
Allow: /publish/
Allow: /worlds
Allow: /about
Allow: /how-it-works
Disallow: /api/
Disallow: /admin/
Disallow: /library/
Disallow: /editor/
Sitemap: https://creader.io/sitemap.xml
Look up this url in the url tool
https://creader.io/.well-known/acme-challenge: 404 application/json; charset=utf-8
https://creader.io/.well-known/csvm: 404 text/html; charset=utf-8
https://creader.io/.well-known/nostr.json: 404 text/html; charset=utf-8
https://creader.io/.well-known/security.txtContact: mailto:security@creader.io
Expires: 2027-07-19T12:39:33.342Z
Preferred-Languages: en
Canonical: https://creader.io/.well-known/security.txt
Policy: https://creader.io/terms
https://creader.io/.well-known/traffic-advice: 404 text/html; charset=utf-8