thingaverse.com
robots.txt
Robots Exclusion Standard data for thingaverse.com
Resource Scan
Scan Details
Site Domain | thingaverse.com |
Base Domain | thingaverse.com |
Scan Status | Ok |
Last Scan | 2024-11-13T21:13:44+00:00 |
Next Scan | 2024-11-20T21:13:44+00:00 |
Last Scan
Scanned | 2024-11-13T21:13:44+00:00 |
URL | http://thingaverse.com/robots.txt |
Redirect | https://www.thingiverse.com/robots.txt |
Redirect Domain | www.thingiverse.com |
Redirect Base | thingiverse.com |
Domain IPs | 162.255.119.241 |
Redirect IPs | 104.19.147.91, 104.19.148.91 |
Response IP | 104.19.148.91 |
Found | Yes |
Hash | 96ed57b66168de662460b9c8315a8570d6e6929fd9e4affd8cf75a4302b34909 |
SimHash | 4001bf384ad0 |
Groups
*
Rule | Path |
---|---|
Disallow | /*/zip |
Disallow | /download%3A* |
Disallow | /login/* |
Disallow | /*/likes |
Disallow | /cdn-cgi/ |
Disallow | /rss/* |
Disallow | /messages/compose |
Disallow | /search |
Disallow | /tag%3A |
Disallow | /apps/customizer/run |
Disallow | */following |
Disallow | */followers |
Disallow | /*/collections/*/things |
Disallow | /thing%3A*/attribution_card |
Disallow | /thing%3A*/collections |
Disallow | /thing%3A*/apps |