IP = 104.18.43.16
robots.txtUser-agent: *
Allow: /
User-agent: Googlebot
Disallow:
Crawl-delay: 1
User-agent: Googlebot-Image
Disallow:
Crawl-delay: 1
User-agent: Mediapartners-Google
Allow: /
Crawl-delay: 1
User-agent: Adsbot-Google
Allow: /
Crawl-delay: 1
User-agent: Bingbot
Allow: /
Crawl-delay: 2
User-agent: Slurp
Allow: /
Crawl-delay: 2
User-agent: DuckDuckBot
Allow: /
Crawl-delay: 2
User-agent: Baiduspider
Allow: /
Crawl-delay: 2
User-agent: YandexBot
Allow: /
Crawl-delay: 2
Sitemap: https://javascriptexpert.com.br/sitemap.xml
Look up this url in the url tool
https://javascriptexpert.com.br/.well-known/acme-challenge: 404 text/html
https://javascriptexpert.com.br/.well-known/csvm: 404 text/html
https://javascriptexpert.com.br/.well-known/nostr.json: 403 text/html; charset=UTF-8
https://javascriptexpert.com.br/.well-known/security.txt: 403 text/html; charset=UTF-8
https://javascriptexpert.com.br/.well-known/traffic-advice: 404 text/html