IP = 188.34.142.224
robots.txt# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
User-agent: GPTBot
Disallow: /
User-agent: *
Disallow: /media_proxy/
Disallow: /interact/
Disallow: /api/v1/instance/domain_blocks
Look up this url in the url tool
https://mstdn.social/.well-known/acme-challenge: 404 */*; charset=utf-8
https://mstdn.social/.well-known/csvm: 404 */*; charset=utf-8
https://mstdn.social/.well-known/nostr.json: 404 */*; charset=utf-8
https://mstdn.social/.well-known/security.txt: 404 */*; charset=utf-8
https://mstdn.social/.well-known/traffic-advice: 404 */*; charset=utf-8