Search

Matched domain: adevait.com

`robots.txt`

Sitemap: https://adevait.com/sitemap.xml

User-agent: ia_archiver
Disallow: /

User-agent: *
Disallow: /search?q=*
Disallow: /cdn-cgi/

#Googlebot
User-agent: Googlebot
Disallow: /cdn-cgi/
Allow: *.css
Allow: *.js# global

User-agent: *
Disallow: /_next/

#Prevent crawling login with query param
User-agent: *
Disallow: /login?

User-agent: *
Disallow: /login/*

Look up this url in the url tool https://adevait.com/.well-known/acme-challenge: 404 application/json; charset=utf-8
https://adevait.com/.well-known/csvm: 404 text/html; charset=utf-8
https://adevait.com/.well-known/nostr.json: 404 text/html; charset=utf-8
https://adevait.com/.well-known/security.txt: 404 text/html; charset=utf-8
https://adevait.com/.well-known/traffic-advice: 404 text/html; charset=utf-8