IP = 104.19.144.66
robots.txtUser-agent: *
Disallow: */fleet/page/
Disallow: /php/
User-agent: deepcrawl
Disallow: /
Sitemap: https://www.sixt.com/sitemap_index.xml
Sitemap: https://www.sixt.com/magazine/category-sitemap.xml
Sitemap: https://www.sixt.com/magazine/post-sitemap.xml
Look up this url in the url tool
https://www.sixt.com/.well-known/acme-challenge: 404 text/html; charset=utf-8
https://www.sixt.com/.well-known/csvm: 404 text/html; charset=utf-8
https://www.sixt.com/.well-known/nostr.json: 404 text/html; charset=utf-8
https://www.sixt.com/.well-known/security.txt: 404 text/html; charset=utf-8
https://www.sixt.com/.well-known/traffic-advice: 404 text/html; charset=utf-8