Search

Matched domain: tech.worldmonitor.app

`robots.txt`

# WorldMonitor - protect API routes from crawlers
User-agent: *
Allow: /
Disallow: /api/
Disallow: /tests/

# Allow social media bots for OG previews
User-agent: Twitterbot
Allow: /api/story
Allow: /api/og-story

User-agent: facebookexternalhit
Allow: /api/story
Allow: /api/og-story

User-agent: LinkedInBot
Allow: /api/story
Allow: /api/og-story

User-agent: Slackbot
Allow: /api/story
Allow: /api/og-story

User-agent: Discordbot
Allow: /api/story
Allow: /api/og-story

Look up this url in the url tool https://tech.worldmonitor.app/.well-known/acme-challenge: 404 application/json; charset=utf-8
https://tech.worldmonitor.app/.well-known/csvm: 404 text/plain; charset=utf-8
https://tech.worldmonitor.app/.well-known/nostr.json: 404 text/plain; charset=utf-8
https://tech.worldmonitor.app/.well-known/security.txt: 404 text/plain; charset=utf-8
https://tech.worldmonitor.app/.well-known/traffic-advice: 404 text/plain; charset=utf-8