Search

Matched domain: www.cl.cam.ac.uk

`robots.txt`

# robots.txt for http://www.cl.cam.ac.uk/

User-agent: *
Disallow: /~aac10/sentiment/
Disallow: /research/nl/nl-download/
Disallow: /RPM/
Disallow: /cgi-bin/

User-agent: University of Cambridge search (search-support@ucs.cam.ac.uk)
Disallow: /~aac10/sentiment/
Disallow: /research/nl/nl-download/
Disallow: /RPM/
Disallow: /users/
Disallow: /~
Disallow: /cgi-bin/

User-agent: Ultraseek (webmaster@ucs.cam.ac.uk)  # old University search engine
Disallow: /~aac10/sentiment/
Disallow: /research/nl/nl-download/
Disallow: /RPM/
Disallow: /users/
Disallow: /~
Disallow: /cgi-bin/

User-agent: Ultraseek (internal search; webmaster@ucs.cam.ac.uk)  # old University search engine
Disallow: /~aac10/sentiment/
Disallow: /research/nl/nl-download/
Disallow: /RPM/
Disallow: /users/
Disallow: /~
Disallow: /cgi-bin/

User-agent: linkchecker
Disallow: /cgi-bin/

Look up this url in the url tool https://www.cl.cam.ac.uk/.well-known/acme-challenge: 404 text/html; charset=iso-8859-1
https://www.cl.cam.ac.uk/.well-known/csvm: 404 text/html; charset=iso-8859-1
https://www.cl.cam.ac.uk/.well-known/nostr.json: 404 text/html; charset=iso-8859-1
https://www.cl.cam.ac.uk/.well-known/security.txt: 404 text/html; charset=iso-8859-1
https://www.cl.cam.ac.uk/.well-known/traffic-advice: 404 text/html; charset=iso-8859-1