Search

Matched domain: rekberpay.com

`robots.txt`

# RekberPay robots.txt
# Open crawl policy: public marketing, blog, and legal content is open
# to every legitimate search engine, AI/LLM crawler, and SEO tool. Only
# authenticated and transactional surfaces are blocked because that HTML
# is user-specific or contains sensitive data. No crawl-delay, no AI
# opt-out â AI and scrapers are intentionally NOT blocked.

User-agent: *
Allow: /
Disallow: /admin
Disallow: /admin/
Disallow: /dashboard
Disallow: /dashboard/
Disallow: /api
Disallow: /api/
Disallow: /uploads
Disallow: /uploads/
Disallow: /login
Disallow: /register
Disallow: /forgot-password
Disallow: /reset-password
Disallow: /verify-email
Disallow: /onboarding
Disallow: /pay/
Disallow: /transaction/
Disallow: /escrow/
Disallow: /invoice/
Disallow: /dispute/
Disallow: /withdraw/
Disallow: /settings
Disallow: /settings/

# AI / LLM crawlers â explicitly welcomed (same policy as *).
User-agent: GPTBot
User-agent: ChatGPT-User
User-agent: OAI-SearchBot
User-agent: ClaudeBot
User-agent: Claude-Web
User-agent: anthropic-ai
User-agent: Google-Extended
User-agent: Applebot-Extended
User-agent: PerplexityBot
User-agent: Perplexity-User
User-agent: CCBot
User-agent: Bytespider
User-agent: Amazonbot
User-agent: Meta-ExternalAgent
User-agent: FacebookBot
User-agent: DuckAssistBot
User-agent: cohere-ai
User-agent: Diffbot
User-agent: Timpibot
Allow: /
Disallow: /admin
Disallow: /admin/
Disallow: /dashboard
Disallow: /dashboard/
Disallow: /api
Disallow: /api/
Disallow: /uploads
Disallow: /uploads/
Disallow: /login
Disallow: /register
Disallow: /forgot-password
Disallow: /reset-password
Disallow: /verify-email
Disallow: /onboarding
Disallow: /pay/
Disallow: /transaction/
Disallow: /escrow/
Disallow: /invoice/
Disallow: /dispute/
Disallow: /withdraw/
Disallow: /settings
Disallow: /settings/

Sitemap: https://rekberpay.com/sitemap.xml

Look up this url in the url tool https://rekberpay.com/.well-known/acme-challenge: 200 text/html
https://rekberpay.com/.well-known/csvm: 200 text/html
https://rekberpay.com/.well-known/nostr.json: 200 text/html

`https://rekberpay.com/.well-known/security.txt`

Contact: mailto:security@rekberpay.com
Expires: 2027-12-31T23:59:59Z
Preferred-Languages: id, en
Canonical: https://rekberpay.com/.well-known/security.txt
Policy: https://rekberpay.com/security/policy

https://rekberpay.com/.well-known/traffic-advice: 200 text/html