Search

Matched domain: gitlab.common-lisp.net

`robots.txt`

User-agent: *
Disallow: /assets/
Disallow: /api/
Disallow: /graphql
Disallow: /explore/
Disallow: /admin/
Disallow: /users/
Disallow: /profile/
Disallow: /dashboard/
Disallow: /-/collect_events

User-agent: Googlebot
Crawl-delay: 10
Allow: /projects/
Allow: /groups/

User-agent: Baiduspider
Disallow: /

User-agent: Baiduspider-render
Disallow: /

User-agent: Bytespider
Disallow: /

User-agent: Amazonbot
Disallow: /

User-agent: Barkrowler
Disallow: /

User-agent: Thinkbot
Disallow: /

User-agent: Diffbot
Disallow: /

User-agent: SemrushBot
Disallow: /

User-agent: AhrefsBot
Disallow: /

Look up this url in the url tool https://gitlab.common-lisp.net/.well-known/acme-challenge: 200 text/html; charset=utf-8
https://gitlab.common-lisp.net/.well-known/csvm: 200 text/html; charset=utf-8
https://gitlab.common-lisp.net/.well-known/nostr.json: 200 text/html; charset=utf-8
https://gitlab.common-lisp.net/.well-known/security.txt: 200 text/html; charset=utf-8
https://gitlab.common-lisp.net/.well-known/traffic-advice: 200 text/html; charset=utf-8