Search

Matched domain: www.techsoft.co.uk

`robots.txt`

# TechSoft UK - crawler policy: index and cite us in any search; do not use our content to train AI models.

# Google-Extended and Applebot-Extended never crawl. Google and Apple read them here to decide whether content
# fetched by Googlebot and Applebot may be used to train their models. The crawlers themselves stay welcome so
# search, Siri and Spotlight keep working.
User-agent: Google-Extended
Disallow: /

User-agent: Applebot-Extended
Disallow: /

# AI training crawlers.
User-agent: GPTBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: meta-externalagent
Disallow: /

User-agent: Bytespider
Disallow: /

# Everyone else: the whole site is open.
User-agent: *
Disallow:

Sitemap: https://www.techsoft.co.uk/sitemap.xml

Look up this url in the url tool https://www.techsoft.co.uk/.well-known/acme-challenge: 404 text/html; charset=utf-8
https://www.techsoft.co.uk/.well-known/csvm: 404 text/html; charset=utf-8
https://www.techsoft.co.uk/.well-known/nostr.json: 404 text/html; charset=utf-8
https://www.techsoft.co.uk/.well-known/security.txt: 404 text/html; charset=utf-8
https://www.techsoft.co.uk/.well-known/traffic-advice: 404 text/html; charset=utf-8