IP = 104.18.42.89
robots.txtSitemap: https://dl.acm.org/sitemap-index-1.txt
User-agent: *
Disallow: /action/
Disallow: /topic/
Disallow: /keyword/
Disallow: /author/
Disallow: /search/
Disallow: /web/
Disallow: /pb/widgets/
Disallow: /servlet/linkout
Disallow: /na101/
Disallow: /na101v1/
Disallow: /na102/
Disallow: /*.cfm
Disallow: /doi/metrics/
Disallow: /authored-by/
Disallow: /history/
Allow: /action/showBmPdf
Allow: /action/showFmPdf
Allow: /action/showAltPdf
Allow: /action/showFmHtml
Allow: /action/showBmHtml
User-agent: facebookexternalhit
User-agent: LinkedInBot
User-agent: Twitterbot
Allow: /
User-agent: GPTBot
Disallow: /
User-agent: ChatGPT-User
Disallow: /
User-agent: CCBot
Disallow: /
User-agent: Google-Extended
Disallow: /
Crawl-delay: 1
Look up this url in the url tool
https://dl.acm.org/.well-known/acme-challenge: 403 text/html; charset=UTF-8
https://dl.acm.org/.well-known/csvm: 403 text/html; charset=UTF-8
https://dl.acm.org/.well-known/nostr.json: 403 text/html; charset=UTF-8
https://dl.acm.org/.well-known/security.txtContact: mailto:security@wiley.com
Expires: 2027-01-01T00:00:00Z
https://dl.acm.org/.well-known/traffic-advice: 403 text/html; charset=UTF-8