IP = 172.66.158.241
robots.txtUser-agent: *
Disallow: /*?comments
Disallow: /wp-content/themes/neilpatel/js/script-comments.js
Disallow: /wp-comments-post.php
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php
Disallow: /wp-login.php
Disallow: /tag/
Disallow: /author/
Disallow: /cdn-cgi/
Disallow: /*/feed/
Disallow: /*/comments/
Disallow: /*?s=
Disallow: /*?p=
Disallow: /license.txt
Content-Signal: ai-train=yes, search=yes, ai-input=yes
User-agent: SiteCheckerBotCrawler
Disallow: /
User-agent: SiteChecker
Disallow: /
Sitemap: https://neilpatel.com/sitemap_index.xml
Look up this url in the url tool
https://neilpatel.com/.well-known/acme-challenge: 403 text/html
https://neilpatel.com/.well-known/csvm: 403 text/html
https://neilpatel.com/.well-known/nostr.json: 403 text/html
https://neilpatel.com/.well-known/security.txt: 403 text/html
https://neilpatel.com/.well-known/traffic-advice: 403 text/html