Search

Matched domain: codereview.appspot.com

`robots.txt`

# Directions for web crawlers.
# See http://www.robotstxt.org/wc/norobots.html.

User-agent: HTTrack
User-agent: puf
User-agent: MSIECrawler
User-agent: Nutch
Disallow: /

User-agent: *
Disallow: /*/diff/
Disallow: /*/diff2/
Disallow: /*/patch/
Disallow: /*/publish
Disallow: /all
Disallow: /download/
Disallow: /rss/
Disallow: /search
Disallow: /tarball/
Disallow: /user/

Look up this url in the url tool https://codereview.appspot.com/.well-known/acme-challenge: 404 text/html; charset=utf-8
https://codereview.appspot.com/.well-known/csvm: 404 text/html; charset=utf-8
https://codereview.appspot.com/.well-known/nostr.json: 404 text/html; charset=utf-8
https://codereview.appspot.com/.well-known/security.txt: 404 text/html; charset=utf-8
https://codereview.appspot.com/.well-known/traffic-advice: 404 text/html; charset=utf-8