Search

Matched domain: modularcode.github.io

`robots.txt`

User-agent: Googlebot
Allow: /
User-agent: Bingbot
Allow: /
User-agent: ChatGPT-User
Allow: /
User-agent: OAI-SearchBot
Allow: /
User-agent: PerplexityBot
Allow: /
User-agent: FirecrawlAgent
Allow: /
User-agent: AndiBot
Allow: /
User-agent: ExaBot
Allow: /
User-agent: PhindBot
Allow: /
User-agent: YouBot
Allow: /
User-agent: *
Disallow: /?s=
Disallow: /page/*/?s=
Disallow: /search/
Disallow: /wp-json/
Disallow: /?rest_route=
Disallow: /wp-admin/
Disallow: /wp-login.php
Disallow: /wp-signup.php
Disallow: /wp-trackback/
Disallow: /xmlrpc.php
Disallow: /trackback/
Disallow: /comments/
Disallow: /?s=*
Disallow: /*?replytocom=
Disallow: /*add-to-cart=*
Disallow: /*orderby=*
Disallow: /cgi-bin/
Disallow: /tmp/
Disallow: /admin/
Disallow: /includes/
Disallow: /modules/
Disallow: /profiles/
Disallow: /scripts/
Disallow: /sites/
Disallow: /themes/
Disallow: /web/
Disallow: /old/
Disallow: /archive/
Allow: /
Sitemap: https://modularcode.io/sitemap.xml

Look up this url in the url tool https://modularcode.github.io/.well-known/acme-challenge: 200 text/html; charset=UTF-8
https://modularcode.github.io/.well-known/csvm: 200 text/html; charset=UTF-8
https://modularcode.github.io/.well-known/nostr.json: 200 text/html; charset=UTF-8
https://modularcode.github.io/.well-known/security.txt: 200 text/html; charset=UTF-8
https://modularcode.github.io/.well-known/traffic-advice: 200 text/html; charset=UTF-8