Search

Matched domain: dngns.github.io

`robots.txt`

User-agent: *
Allow: /

# Allow Social Media Scrapers
User-agent: facebookexternalhit
Allow: /
User-agent: Facebot
Allow: /
User-agent: Twitterbot
Allow: /
User-agent: LinkedInBot
Allow: /
User-agent: Discordbot
Allow: /

# Block Aggressive Scrapers & Known Spam Bots
User-agent: GPTBot
Disallow: /
User-agent: CCBot
Disallow: /
User-agent: SemrushBot
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: dotbot
Disallow: /
User-agent: Rogerbot
Disallow: /

Look up this url in the url tool https://dngns.github.io/.well-known/acme-challenge: 404 text/html; charset=utf-8
https://dngns.github.io/.well-known/csvm: 404 text/html; charset=utf-8
https://dngns.github.io/.well-known/nostr.json: 404 text/html; charset=utf-8
https://dngns.github.io/.well-known/security.txt: 404 text/html; charset=utf-8
https://dngns.github.io/.well-known/traffic-advice: 404 text/html; charset=utf-8