shutterstock.com
robots.txt
Robots Exclusion Standard data for shutterstock.com
Resource Scan
Scan Details
| Site Domain | shutterstock.com |
| Base Domain | shutterstock.com |
| Scan Status | Ok |
| Last Scan | 2024-04-24T14:37:14+00:00 |
| Next Scan | 2024-05-01T14:37:14+00:00 |
Last Scan
| Scanned | 2024-04-24T14:37:14+00:00 |
| URL | https://shutterstock.com/robots.txt |
| Redirect | https://www.shutterstock.com:443/robots.txt |
| Redirect Domain | www.shutterstock.com |
| Redirect Base | shutterstock.com |
| Domain IPs | 75.2.58.105, 99.83.219.164 |
| Redirect IPs | 13.225.4.101, 13.225.4.17, 13.225.4.19, 13.225.4.64 |
| Response IP | 13.225.4.101 |
| Found | Yes |
| Hash | b2113602429056ec2b8b6a3de7184ce8135896be78ba186c9328404a58341a8a |
| SimHash | 8641fad78c26 |
Groups
*
| Rule | Path |
|---|---|
| Allow | */search/login |
| Allow | */login$ |
| Allow | /login.mhtml$ |
| Disallow | */login |
| Disallow | */base/logout |
| Allow | */search/account |
| Disallow | */account |
| Disallow | /subscribe_success |
| Allow | /download_history.mhtml$ |
| Disallow | /download |
| Disallow | /checkout |
| Disallow | /account_purchase_history.mhtml |
| Disallow | /contests |
| Allow | */search/portfolio |
| Disallow | */portfolio |
| Disallow | */editor/template |
| Disallow | */editor/design |
| Disallow | */editor/search |
| Disallow | */video/cart |
| Disallow | */video/checkout |
| Disallow | */music/cart |
| Disallow | */music/user |
| Disallow | */music/orders |
| Disallow | /web/checkout |
| Disallow | /sstk/api/footage/wasabi/* |
| Disallow | /studioapi/wasabi/* |
| Disallow | /sstk/api/* |
| Disallow | /studioapi/* |
| Disallow | /napi/* |
| Disallow | /api/* |
| Disallow | /feed.mhtml |
| Disallow | /nuance-chat.html |
| Disallow | /sw/* |
| Disallow | /base/login |
| Allow | */search/collections |
| Allow | */editorial/collections |
| Disallow | */collections |
| Disallow | */generate/* |
| Allow | */generate/$ |
| Disallow | /image-*chatId%3D* |
| Disallow | /image-*tool%3D* |
| Disallow | /image-*mode%3D* |
| Disallow | /blog/?s=* |
| Disallow | */search/ris/* |
| Disallow | */search/models/* |
| Disallow | */editor/image/* |
| Allow | */editor/image/$ |
bingbot
| Product | Comment |
|---|---|
| bingbot | Disallow ADPs for Bing |
| Rule | Path | Comment |
|---|---|---|
| Allow | */image-illustration/*.jpg | Allow Images that match Image ADP paths |
| Allow | */image-illustration/*.webp | - |
| Allow | */image-photo/*.jpg | - |
| Allow | */image-photo/*.webp | - |
| Allow | */image-vector/*.jpg | - |
| Allow | */image-vector/*.webp | - |
| Allow | */search/login | - |
| Allow | */login$ | - |
| Allow | /login.mhtml$ | - |
| Disallow | */login | - |
| Disallow | */base/logout | - |
| Allow | */search/account | - |
| Disallow | */account | - |
| Disallow | /subscribe_success | - |
| Allow | /download_history.mhtml$ | - |
| Disallow | /download | - |
| Disallow | /checkout | - |
| Disallow | /account_purchase_history.mhtml | - |
| Disallow | /contests | - |
| Allow | */search/portfolio | - |
| Disallow | */portfolio | - |
| Disallow | */editor/template | - |
| Disallow | */editor/design | - |
| Disallow | */editor/search | - |
| Disallow | */video/cart | - |
| Disallow | */video/checkout | - |
| Disallow | */music/cart | - |
| Disallow | */music/user | - |
| Disallow | */music/orders | - |
| Disallow | /web/checkout | - |
| Disallow | /sstk/api/footage/wasabi/* | - |
| Disallow | /studioapi/wasabi/* | - |
| Disallow | /sstk/api/* | - |
| Disallow | /studioapi/* | - |
| Disallow | /napi/* | - |
| Disallow | /api/* | - |
| Disallow | /feed.mhtml | - |
| Disallow | /nuance-chat.html | - |
| Disallow | /sw/* | - |
| Disallow | /base/login | - |
| Allow | */search/collections | - |
| Allow | */editorial/collections | - |
| Disallow | */collections | - |
| Disallow | */generate/* | - |
| Allow | */generate/$ | - |
| Disallow | */search/ris/* | - |
| Disallow | */search/models/* | - |
| Disallow | */editor/image/* | Editor Images |
| Allow | */editor/image/$ | - |
| Disallow | /image-*chatId%3D* | - |
| Disallow | /image-*tool%3D* | - |
| Disallow | /image-*mode%3D* | - |
| Disallow | /blog/?s=* | - |
yandex
| Product | Comment |
|---|---|
| yandex | Disallow ADPs for Yandex (cannot combine with Bing) |
| Rule | Path | Comment |
|---|---|---|
| Allow | */image-illustration/*.jpg | Allow Images that match Image ADP paths |
| Allow | */image-illustration/*.webp | - |
| Allow | */image-photo/*.jpg | - |
| Allow | */image-photo/*.webp | - |
| Allow | */image-vector/*.jpg | - |
| Allow | */image-vector/*.webp | - |
| Disallow | */image-editorial/* | Disallow Editorial ADPs |
| Disallow | */music/track-* | Disallow Music ADPs |
| Disallow | */image-illustration/* | Disallow Image ADPs |
| Disallow | */image-photo/* | - |
| Disallow | */image-vector/* | - |
| Disallow | */image-generated/* | - |
| Disallow | */video/clip-* | Disallow Video ADPs |
| Allow | */search/login | - |
| Allow | */login$ | - |
| Allow | /login.mhtml$ | - |
| Disallow | */login | - |
| Disallow | */base/logout | - |
| Allow | */search/account | - |
| Disallow | */account | - |
| Disallow | /subscribe_success | - |
| Allow | /download_history.mhtml$ | - |
| Disallow | /download | - |
| Disallow | /checkout | - |
| Disallow | /account_purchase_history.mhtml | - |
| Disallow | /contests | - |
| Allow | */search/portfolio | - |
| Disallow | */portfolio | - |
| Disallow | */editor/template | - |
| Disallow | */editor/design | - |
| Disallow | */editor/search | - |
| Disallow | */video/cart | - |
| Disallow | */video/checkout | - |
| Disallow | */music/cart | - |
| Disallow | */music/user | - |
| Disallow | */music/orders | - |
| Disallow | /web/checkout | - |
| Disallow | /sstk/api/footage/wasabi/* | - |
| Disallow | /studioapi/wasabi/* | - |
| Disallow | /sstk/api/* | - |
| Disallow | /studioapi/* | - |
| Disallow | /napi/* | - |
| Disallow | /api/* | - |
| Disallow | /feed.mhtml | - |
| Disallow | /nuance-chat.html | - |
| Disallow | /sw/* | - |
| Disallow | /base/login | - |
| Allow | */search/collections | - |
| Allow | */editorial/collections | - |
| Disallow | */collections | - |
| Disallow | */generate/* | - |
| Allow | */generate/$ | - |
| Disallow | */search/ris/* | - |
| Disallow | */search/models/* | - |
| Disallow | */editor/image/* | Editor Images |
| Allow | */editor/image/$ | - |
| Disallow | /image-*chatId%3D* | - |
| Disallow | /image-*tool%3D* | - |
| Disallow | /image-*mode%3D* | - |
| Disallow | /blog/?s=* | - |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.shutterstock.com/sitemaps/image/search-2022/sitemap-image-search-2022-index.xml |
| sitemap | https://www.shutterstock.com/sitemaps/video/search-2022/sitemap-video-search-2022-index.xml |
| sitemap | https://www.shutterstock.com/sitemaps/editorial/sitemap-editorial-index.xml |
| sitemap | https://www.shutterstock.com/blog/sitemap_index.xml |
| sitemap | https://www.shutterstock.com/blog/india/sitemap_index.xml |
| sitemap | https://www.shutterstock.com/de/blog/sitemap_index.xml |
| sitemap | https://www.shutterstock.com/es/blog/sitemap_index.xml |
| sitemap | https://www.shutterstock.com/fr/blog/sitemap_index.xml |
| sitemap | https://www.shutterstock.com/ja/blog/sitemap_index.xml |
| sitemap | https://www.shutterstock.com/ko/blog/sitemap_index.xml |
| sitemap | https://www.shutterstock.com/th/blog/sitemap_index.xml |
| sitemap | https://www.shutterstock.com/pt/blog/sitemap_index.xml |
| sitemap | https://www.shutterstock.com/zh-Hant/blog/sitemap_index.xml |
Comments