IP = 104.21.48.239
robots.txtUser-agent: *
Allow: /
Allow: /search
Allow: /illustrations
Allow: /illustrations/*
Allow: /blog
Allow: /illustration/*
Allow: /blog/*
# Prevent crawling of special pages
Disallow: /api/
Disallow: /download/*
Disallow: /login
Disallow: /signup
Disallow: /dashboard
Disallow: /admin
Disallow: /*.json$
Disallow: /*?*
# AI Training Protection - only for artwork
User-agent: GPTBot
Disallow: /illustrations/*/svg
Disallow: /download/*
Disallow: /*.svg$
Allow: /
User-agent: ChatGPT-User
Disallow: /illustrations/*/svg
Disallow: /download/*
Disallow: /*.svg$
Allow: /
User-agent: Google-Extended
Disallow: /illustrations/*/svg
Disallow: /download/*
Disallow: /*.svg$
Allow: /
User-agent: anthropic-ai
Disallow: /illustrations/*/svg
Disallow: /download/*
Disallow: /*.svg$
Allow: /
# Point to your sitemap
Sitemap: https://undraw.co/sitemap.xml
Look up this url in the url tool
https://undraw.co/.well-known/acme-challenge: 404 text/html; charset=utf-8
https://undraw.co/.well-known/csvm: 404 text/html; charset=utf-8
https://undraw.co/.well-known/nostr.json: 404 text/html; charset=utf-8
https://undraw.co/.well-known/security.txt: 404 text/html; charset=utf-8
https://undraw.co/.well-known/traffic-advice: 404 text/html; charset=utf-8