adwww.shutterstock.com
robots.txt
Robots Exclusion Standard data for adwww.shutterstock.com
Resource Scan
Scan Details
Site Domain | adwww.shutterstock.com |
Base Domain | shutterstock.com |
Scan Status | Ok |
Last Scan | 2024-04-17T19:18:06+00:00 |
Next Scan | 2024-05-17T19:18:06+00:00 |
Last Scan
Scanned | 2024-04-17T19:18:06+00:00 |
URL | https://adwww.shutterstock.com/robots.txt |
Domain IPs | 44.206.117.250, 52.45.187.246, 54.164.185.105, 54.205.199.133, 54.80.240.57 |
Response IP | 54.80.240.57 |
Found | Yes |
Hash | 65352ab338bdbcc0c39dec32210c75bc7cc39ae061c42a2bab5c00eb57c6808b |
SimHash | fa199815e03e |
Groups
*
Rule | Path |
---|---|
Disallow | /login |
Disallow | /base/logout |
Disallow | /account |
Disallow | /subscribe_success |
Disallow | /download |
Disallow | /checkout |
Disallow | /account_purchase_history.mhtml |
Disallow | /contests |
Disallow | /portfolio |
Disallow | /editor/template |
Disallow | /editor/design |
Disallow | /editor/search |
Disallow | /video/cart |
Disallow | /video/checkout |
Disallow | /music/cart |
Disallow | /music/user |
Disallow | /music/orders |
Disallow | /web/checkout |
Disallow | /sstk/api/footage/wasabi/* |
Disallow | /studioapi/wasabi/* |
Disallow | /sstk/api/* |
Disallow | /studioapi/* |
Disallow | /feed.mhtml |
Disallow | /nuance-chat.html |
Disallow | /sw/* |