thumb6.shutterstock.com
robots.txt
Robots Exclusion Standard data for thumb6.shutterstock.com
Resource Scan
Scan Details
Site Domain | thumb6.shutterstock.com |
Base Domain | shutterstock.com |
Scan Status | Ok |
Last Scan | 2024-04-21T05:25:41+00:00 |
Next Scan | 2024-05-21T05:25:41+00:00 |
Last Scan
Scanned | 2024-04-21T05:25:41+00:00 |
URL | https://thumb6.shutterstock.com/robots.txt |
Domain IPs | 35.168.235.215, 52.3.171.75, 52.72.83.7, 54.164.212.84, 54.225.184.145 |
Response IP | 52.3.171.75 |
Found | Yes |
Hash | 65352ab338bdbcc0c39dec32210c75bc7cc39ae061c42a2bab5c00eb57c6808b |
SimHash | fa199815e03e |
Groups
*
Rule | Path |
---|---|
Disallow | /login |
Disallow | /base/logout |
Disallow | /account |
Disallow | /subscribe_success |
Disallow | /download |
Disallow | /checkout |
Disallow | /account_purchase_history.mhtml |
Disallow | /contests |
Disallow | /portfolio |
Disallow | /editor/template |
Disallow | /editor/design |
Disallow | /editor/search |
Disallow | /video/cart |
Disallow | /video/checkout |
Disallow | /music/cart |
Disallow | /music/user |
Disallow | /music/orders |
Disallow | /web/checkout |
Disallow | /sstk/api/footage/wasabi/* |
Disallow | /studioapi/wasabi/* |
Disallow | /sstk/api/* |
Disallow | /studioapi/* |
Disallow | /feed.mhtml |
Disallow | /nuance-chat.html |
Disallow | /sw/* |