IP = 104.26.7.129
robots.txtUser-agent: *
Allow: /
Disallow: /unsubscribed/
Disallow: /error/
Disallow: /close
Disallow: /t/
Disallow: /te/
Disallow: /i/
Disallow: /w/
# Certain social media sites are whitelisted to allow crawlers to access page markup when links to /images are shared.
User-agent: Twitterbot
Allow: /w/
Allow: /i/
User-agent: facebookexternalhit
Allow: /w/
Allow: /i/
Sitemap: https://getsitecontrol.com/sitemap.xml
Look up this url in the url tool
https://getsitecontrol.com/.well-known/acme-challenge: 404 text/html
https://getsitecontrol.com/.well-known/csvm: 404 text/html
https://getsitecontrol.com/.well-known/nostr.json: 404 text/html
https://getsitecontrol.com/.well-known/security.txt: 404 text/html
https://getsitecontrol.com/.well-known/traffic-advice: 404 text/html