blenderkit.com
robots.txt
Robots Exclusion Standard data for blenderkit.com
Resource Scan
Scan Details
Site Domain | blenderkit.com |
Base Domain | blenderkit.com |
Scan Status | Ok |
Last Scan | 2025-09-16T21:06:10+00:00 |
Next Scan | 2025-10-16T21:06:10+00:00 |
Last Scan
Scanned | 2025-09-16T21:06:10+00:00 |
URL | https://blenderkit.com/robots.txt |
Redirect | https://www.blenderkit.com/robots.txt |
Redirect Domain | www.blenderkit.com |
Redirect Base | blenderkit.com |
Domain IPs | 104.26.4.20, 104.26.5.20, 172.67.70.27, 2606:4700:20::681a:414, 2606:4700:20::681a:514, 2606:4700:20::ac43:461b |
Redirect IPs | 104.26.4.20, 104.26.5.20, 172.67.70.27, 2606:4700:20::681a:414, 2606:4700:20::681a:514, 2606:4700:20::ac43:461b |
Response IP | 172.67.70.27 |
Found | Yes |
Hash | dd9d0de4ad59c6931c658ac1547d1a243d7f93914a5f6fe0a44fbef4c4c8b897 |
SimHash | e018f6564335 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /complete/*/ |
Disallow | /_util/* |
Disallow | /cms/* |
Disallow | /api/* |
Disallow | /*/login/* |
Disallow | /two-factor-social-auth/ |
Disallow | /my-assets-table/ |
Disallow | /complete/google-oauth2/ |
Disallow | /complete/facebook/ |
Disallow | /login/*/ |
Disallow | /my-assets-table |
Disallow | /payments/* |
Disallow | /plans-payments/* |
Disallow | /r/* |
Disallow | /plans-paypal/* |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Warnings
- `host` is not a known field.