Search

Matched domain: www.thingiverse.com

IP = 104.19.148.91

robots.txt

User-agent: *
Disallow: /*/zip
Disallow: /download:*
Disallow: /login*
Disallow: /*/likes
Disallow: /cdn-cgi/
Disallow: /rss/*
Disallow: /messages/compose
Disallow: /apps/customizer/run
Disallow: */following
Disallow: */followers
Disallow: /*/collections/*/things
Disallow: /thing:*/attribution_card
Disallow: /thing:*/collections
Disallow: /thing:*/apps

# Block search crawlers from crawling search results 
User-agent: Googlebot
Disallow: /search
Disallow: /tag:*

User-agent: Bingbot
Disallow: /search
Disallow: /tag:*

User-agent: DuckDuckBot
Disallow: /search
Disallow: /tag:*

User-agent: Yandex
Disallow: /search
Disallow: /tag:*

User-agent: SemrushBot
Disallow: /

Look up this url in the url tool https://www.thingiverse.com/.well-known/acme-challenge: 429 text/html; charset=UTF-8
https://www.thingiverse.com/.well-known/csvm: 429 text/html; charset=UTF-8
https://www.thingiverse.com/.well-known/nostr.json: 429 text/html; charset=UTF-8
https://www.thingiverse.com/.well-known/security.txt: 429 text/html; charset=UTF-8
https://www.thingiverse.com/.well-known/traffic-advice: 429 text/html; charset=UTF-8