Search

Matched domain: tester.engineering

IP = 103.27.32.44

robots.txt

# robots.txt for tester.engineering
# Tester Engineering Suite — dedicated product site
# Operated by Tester Present — Specialist Automotive Solutions

User-agent: *
Allow: /
Disallow: /assets/internal/
Disallow: /admin/
Disallow: /*.json$
Disallow: /*?*

# Major search-engine crawlers
User-agent: Googlebot
Allow: /

User-agent: Bingbot
Allow: /

User-agent: DuckDuckBot
Allow: /

User-agent: Slurp
Allow: /

User-agent: Baiduspider
Allow: /

User-agent: YandexBot
Allow: /

# Block AI training crawlers — same posture as the parent site
User-agent: GPTBot
Disallow: /

User-agent: ChatGPT-User
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: anthropic-ai
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: PerplexityBot
Disallow: /

# Throttle aggressive SEO scrapers
User-agent: AhrefsBot
Crawl-delay: 10

User-agent: SemrushBot
Crawl-delay: 10

User-agent: MJ12bot
Crawl-delay: 10

# Sitemap
Sitemap: https://tester.engineering/sitemap.xml

# Canonical host
Host: tester.engineering

Look up this url in the url tool https://tester.engineering/.well-known/acme-challenge: 403 text/html
https://tester.engineering/.well-known/csvm: 404 text/html
https://tester.engineering/.well-known/nostr.json: 404 text/html
https://tester.engineering/.well-known/security.txt: 404 text/html
https://tester.engineering/.well-known/traffic-advice: 404 text/html