Search

Matched domain: crate.io

`robots.txt`

User-agent: *
Disallow: /_hcms/preview/
Disallow: /hs/manage-preferences/
Disallow: /hs/preferences-center/
Disallow: /*?*hs_preview=*
Disallow: /*?*hsCacheBuster=*

User-agent: MJ12bot
Disallow: /
Sitemap: https://cratedb.com/hubfs/sitemap_index.xml
Disallow: /_hcms/preview/
Disallow: /hs/manage-preferences/
Disallow: /hs/preferences-center/
Disallow: /*?*hs_preview=*
Disallow: /*?*hsCacheBuster=*

Look up this url in the url tool https://crate.io/.well-known/acme-challenge: 409 text/plain; charset=UTF-8
https://crate.io/.well-known/csvm: 404 text/html
https://crate.io/.well-known/nostr.json: 404 text/html
https://crate.io/.well-known/security.txt: 404 text/html
https://crate.io/.well-known/traffic-advice: 404 text/html