Search

Matched domain: aur.archlinux.org

`robots.txt`

User-agent: *
# block the search page from indexing, as the search is done via URL parameters
Disallow: /packages?*
# block all interactive things from being indexed, such as posting requests
Disallow: /pkgbase/*
# block all account pages from being indexed, as they require login anyways
Disallow: /account/*
# block the cgit interface except for the useful things
Disallow: /cgit/aur.git/*
Allow: /cgit/aur.git/tree
Allow: /cgit/aur.git/log
Crawl-delay: 2

Look up this url in the url tool https://aur.archlinux.org/.well-known/acme-challenge: 404 text/html; charset=utf-8
https://aur.archlinux.org/.well-known/csvm: 404 text/html; charset=utf-8
https://aur.archlinux.org/.well-known/nostr.json: 404 text/html; charset=utf-8
https://aur.archlinux.org/.well-known/security.txt: 404 text/html; charset=utf-8
https://aur.archlinux.org/.well-known/traffic-advice: 404 text/html; charset=utf-8