Search

Matched domain: duckduckgo.com

`robots.txt`

User-agent: *
Disallow: /lite
Disallow: /html

# Block query strings on other pages; allow them at the root (covers SERP's
# ?q= and any other root-level params).
# Google/Bing apply the least-restrictive rule on a tie, so Allow wins for root.
Disallow: /*?
Allow: /?*

# Embeddable search box (search.html, incl. ?duck=yes) — keep crawlable so its
# noindex meta tag is fetched and honored, dropping it from search indexes
Allow: /search.html

# chrome new tab page
Disallow: /chrome_newtab

# Email Protection
Disallow: /email/
Allow: /email/$
Allow: /email/privacy-guarantees
Allow: /email/privacy-terms

User-agent: ia_archiver
Disallow: /

Sitemap: https://duckduckgo.com/sitemap.xml
Sitemap: https://duckduckgo.com/duckduckgo-help-pages/sitemap.xml

Look up this url in the url tool https://duckduckgo.com/.well-known/acme-challenge: 410 text/html; charset=UTF-8
https://duckduckgo.com/.well-known/csvm: 410 text/html; charset=UTF-8
https://duckduckgo.com/.well-known/nostr.json: 410 text/html; charset=UTF-8
https://duckduckgo.com/.well-known/security.txt: 410 text/html; charset=UTF-8
https://duckduckgo.com/.well-known/traffic-advice: 410 text/html; charset=UTF-8