Search

Matched domain: www.britannica.com

`robots.txt`

# /robots.txt file for encyclopaedia britannica 

Sitemap: https://www.britannica.com/bps-ssl-gsm-index.xml 

User-agent: * 
Disallow: /search
Disallow: /cdn-cgi/

User-agent: Mediapartners-Google
Allow: /
User-agent: AdsBot-Google
Allow: /
User-agent: AmazonAdBot
Allow: /
User-agent: Bidswitchbot
Allow: /
User-agent: CriteoBot
Allow: /
User-agent: DoubleVerifyBot
Allow: /
User-agent: DVBot
Allow: /
User-agent: Grapeshot
Allow: /
User-agent: Gumgum
Allow: /
User-agent: IAS_admantx
Allow: /
User-agent: IAS_crawler
Allow: /
User-agent: IAS_wombles
Allow: /
User-agent: Leikibot
Allow: /
User-agent: Opebot-v
Allow: /
User-agent: Peer39_crawler
Allow: /
User-agent: Proximic
Allow: /
User-agent: PubMatic Crawler Bot
Allow: /
User-agent: SinceraSyntheticUser
Allow: /
User-agent: SlickBot
Allow: /
User-agent: TTD-Content
Allow: /

Look up this url in the url tool https://www.britannica.com/.well-known/acme-challenge: 404 text/html;charset=UTF-8
https://www.britannica.com/.well-known/csvm: 404 text/html;charset=UTF-8
https://www.britannica.com/.well-known/nostr.json: 404 text/html;charset=UTF-8
https://www.britannica.com/.well-known/security.txt: 404 text/html;charset=UTF-8
https://www.britannica.com/.well-known/traffic-advice: 404 text/html;charset=UTF-8