IP = 172.67.156.173
robots.txtUser-agent: *
Disallow: /account/
Disallow: /api/
Disallow: /embed/
Disallow: /login/
Disallow: /authenticate
Disallow: /authenticate/*
Disallow: /logout/
Disallow: /meta/
Disallow: /oauth/
Disallow: /open/
Disallow: /stats/
Disallow: /thread/*/fetch
Disallow: /thread/*/fetchx
Disallow: /thread/*/refresh
Disallow: /thread/*/refreshx
Disallow: /500/
Sitemap: https://threadshots.threadreaderapp.com/urllist.txt
Look up this url in the url tool
https://threadreaderapp.com/.well-known/acme-challenge: 404 text/html; charset=UTF-8
https://threadreaderapp.com/.well-known/csvm: 404 text/html; charset=UTF-8
https://threadreaderapp.com/.well-known/nostr.json: 404 text/html; charset=UTF-8
https://threadreaderapp.com/.well-known/security.txt: 404 text/html; charset=UTF-8
https://threadreaderapp.com/.well-known/traffic-advice: 404 text/html; charset=UTF-8